-- Logs begin at Sun 2022-09-18 00:10:22 UTC, end at Sun 2022-09-18 01:11:09 UTC. -- Sep 18 00:47:10.356849 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Sep 18 00:47:10.364220 dv-cinder-master-3-smb devstack@n-api.service[105447]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 18 00:47:10.366183 dv-cinder-master-3-smb devstack@n-api.service[105447]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 18 00:47:10 2022] *** Sep 18 00:47:10.366183 dv-cinder-master-3-smb devstack@n-api.service[105447]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 18 00:47:10.366183 dv-cinder-master-3-smb devstack@n-api.service[105447]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 18 00:47:10.366183 dv-cinder-master-3-smb devstack@n-api.service[105447]: nodename: dv-cinder-master-3-smb Sep 18 00:47:10.366183 dv-cinder-master-3-smb devstack@n-api.service[105447]: machine: x86_64 Sep 18 00:47:10.366183 dv-cinder-master-3-smb devstack@n-api.service[105447]: clock source: unix Sep 18 00:47:10.366183 dv-cinder-master-3-smb devstack@n-api.service[105447]: pcre jit disabled Sep 18 00:47:10.366183 dv-cinder-master-3-smb devstack@n-api.service[105447]: detected number of CPU cores: 4 Sep 18 00:47:10.366742 dv-cinder-master-3-smb devstack@n-api.service[105447]: current working directory: / Sep 18 00:47:10.366742 dv-cinder-master-3-smb devstack@n-api.service[105447]: detected binary path: /usr/bin/uwsgi-core Sep 18 00:47:10.366742 dv-cinder-master-3-smb devstack@n-api.service[105447]: your processes number limit is 47680 Sep 18 00:47:10.366742 dv-cinder-master-3-smb devstack@n-api.service[105447]: your memory page size is 4096 bytes Sep 18 00:47:10.366742 dv-cinder-master-3-smb devstack@n-api.service[105447]: detected max file descriptor number: 2048 Sep 18 00:47:10.366742 dv-cinder-master-3-smb devstack@n-api.service[105447]: lock engine: pthread robust mutexes Sep 18 00:47:10.366742 dv-cinder-master-3-smb devstack@n-api.service[105447]: thunder lock: enabled Sep 18 00:47:10.366742 dv-cinder-master-3-smb devstack@n-api.service[105447]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 18 00:47:10.366742 dv-cinder-master-3-smb devstack@n-api.service[105447]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 18 00:47:10.407373 dv-cinder-master-3-smb devstack@n-api.service[105447]: Python main interpreter initialized at 0x5588277819c0 Sep 18 00:47:10.407373 dv-cinder-master-3-smb devstack@n-api.service[105447]: python threads support enabled Sep 18 00:47:10.407373 dv-cinder-master-3-smb devstack@n-api.service[105447]: your server socket listen backlog is limited to 100 connections Sep 18 00:47:10.407373 dv-cinder-master-3-smb devstack@n-api.service[105447]: your mercy for graceful operations on workers is 90 seconds Sep 18 00:47:10.407758 dv-cinder-master-3-smb devstack@n-api.service[105447]: mapped 403077 bytes (393 KB) for 2 cores Sep 18 00:47:10.407841 dv-cinder-master-3-smb devstack@n-api.service[105447]: *** Operational MODE: preforking *** Sep 18 00:47:10.408074 dv-cinder-master-3-smb devstack@n-api.service[105447]: *** uWSGI is running in multiple interpreter mode *** Sep 18 00:47:10.408074 dv-cinder-master-3-smb devstack@n-api.service[105447]: spawned uWSGI master process (pid: 105447) Sep 18 00:47:10.408277 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Sep 18 00:47:10.409792 dv-cinder-master-3-smb devstack@n-api.service[105447]: spawned uWSGI worker 1 (pid: 105448, cores: 1) Sep 18 00:47:10.409792 dv-cinder-master-3-smb devstack@n-api.service[105447]: spawned uWSGI worker 2 (pid: 105449, cores: 1) Sep 18 00:47:10.409792 dv-cinder-master-3-smb devstack@n-api.service[105447]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 18 00:47:11.066157 dv-cinder-master-3-smb devstack@n-api.service[105449]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 18 00:47:11.070341 dv-cinder-master-3-smb devstack@n-api.service[105448]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 18 00:47:12.156228 dv-cinder-master-3-smb devstack@n-api.service[105449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:47:12.156228 dv-cinder-master-3-smb devstack@n-api.service[105449]: from cryptography.utils import int_from_bytes Sep 18 00:47:12.156824 dv-cinder-master-3-smb devstack@n-api.service[105449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:47:12.156824 dv-cinder-master-3-smb devstack@n-api.service[105449]: from cryptography.utils import int_from_bytes Sep 18 00:47:12.162863 dv-cinder-master-3-smb devstack@n-api.service[105448]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:47:12.162863 dv-cinder-master-3-smb devstack@n-api.service[105448]: from cryptography.utils import int_from_bytes Sep 18 00:47:12.163304 dv-cinder-master-3-smb devstack@n-api.service[105448]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:47:12.163304 dv-cinder-master-3-smb devstack@n-api.service[105448]: from cryptography.utils import int_from_bytes Sep 18 00:47:14.679841 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 00:47:14.680431 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 00:47:14.680794 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 00:47:14.680898 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 00:47:14.680986 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 00:47:14.681083 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 00:47:14.681186 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 00:47:14.681281 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 00:47:14.681371 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 00:47:14.681461 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 00:47:14.681550 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.681713 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.681863 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.682038 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.682182 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.682361 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.682498 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.682681 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.682846 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.683036 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.683140 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.683350 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.683474 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.683669 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.683805 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.683985 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.684114 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.684311 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.684445 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.684579 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.684707 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.684877 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.685015 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.685202 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.685341 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.685518 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.685648 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.685822 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.685958 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.686131 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.686271 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.686435 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.686564 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.686741 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.686896 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.687069 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.687199 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.687383 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.687556 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.687881 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.688028 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.688189 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.688307 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.688495 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.688624 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.688805 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.688990 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.689143 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.689270 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.689444 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.689619 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.689867 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.690019 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.690184 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.690357 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.690536 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.690690 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.690821 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.691083 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.691194 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.691422 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.691512 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.691739 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.691844 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.692049 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.692157 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.692360 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.692459 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.692770 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.692876 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.693065 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.693142 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.693376 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.693506 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.693696 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.693802 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.694016 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.694120 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.694319 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.694410 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.694642 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.694734 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.694985 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.695089 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.695303 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.695402 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.695623 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.695804 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.695955 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.696098 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.696249 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.696412 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.696586 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.696733 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.696874 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.697015 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.697162 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.697313 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.697462 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.697612 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.697754 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.697901 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.698051 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.698201 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.698353 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.698494 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.698635 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.698775 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.698985 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.699146 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.699298 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.699441 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.699669 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.699826 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.699984 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.700146 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.700291 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.700432 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.700572 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.700726 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.700885 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.701032 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.701174 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.701321 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.701462 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.701616 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.701758 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.701909 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.702056 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.702198 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.702347 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.702489 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.702629 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.702775 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.702942 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.703111 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.703335 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.703484 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.703672 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.703826 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.703989 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.704131 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.704300 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.704447 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.704589 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.704729 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.704876 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.705032 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.705184 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.705326 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.705466 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.705656 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.705656 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.705945 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.706098 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.706241 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.706382 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.706528 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.706669 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.706856 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.707006 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.707147 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.707286 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.707427 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.707566 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.707725 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.707875 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.708016 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.708156 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.708304 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.708445 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.708595 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.708747 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.708887 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.709036 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.709175 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.709315 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.709467 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.709647 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.709870 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.710018 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.710158 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.710308 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.710456 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.710599 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.710740 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.710916 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.711059 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.711212 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.711354 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.711502 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.711654 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.711795 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.711943 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.712098 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.712240 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.712389 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.712529 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.712671 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.712821 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.712972 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.713113 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.713254 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.713486 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.713651 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.713793 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.713944 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.714085 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.714240 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.714386 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.714527 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.714675 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.714840 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.714988 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.715129 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.715287 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.715452 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.715603 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.715798 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.715946 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.716087 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.716226 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.716367 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.716507 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.716656 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.716797 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.716937 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.717076 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.717216 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.717367 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.717520 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.717668 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.717818 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.717961 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.718101 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.718250 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.718397 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.718545 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.718692 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.718859 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.719008 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.719228 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.719383 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.719525 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.719665 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.719814 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.720044 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.720200 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.720343 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.720483 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.720624 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.721268 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.721415 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.721565 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.721707 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.721857 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.722006 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.722006 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.722006 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.722413 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.722553 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.722693 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.722862 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.723010 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.723160 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.723301 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.723466 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.723678 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.723834 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.723982 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.724132 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.724296 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.724439 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.724580 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.724720 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.724867 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.725017 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.725158 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:47:14.725307 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.725449 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.725600 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.725748 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.725937 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.726080 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.726229 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.726371 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.726518 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.726676 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.726874 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.727024 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.727164 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.727305 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.727445 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.727607 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.727750 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.727889 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.728028 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.728178 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.728336 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.728486 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.728626 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.728765 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.728915 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.729082 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.729243 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.729405 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.729548 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.729694 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.729841 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.729982 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.730220 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.730369 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.730511 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.730651 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.730813 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.730975 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.731125 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.731267 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.731418 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.731559 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.731706 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.731853 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.732008 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.732163 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.732305 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.732445 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.732587 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.732735 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.732890 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.733032 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.733173 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.733322 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.733469 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.733624 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.733853 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.734001 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.734149 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.734302 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.734450 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.734600 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.734745 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.734945 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.735088 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.735239 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.735391 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.735542 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.735684 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.735835 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.736025 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.736179 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.736320 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.736506 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.737189 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.737189 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.737458 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.737598 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.737759 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.737910 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.738052 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.738192 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.738332 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.738472 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.738621 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.738762 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.738933 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.739074 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.739251 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.739401 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.739552 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.739704 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.739853 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.740002 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.740166 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.740397 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.740552 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.740695 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.740836 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.740984 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.741133 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.741274 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.741423 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.741565 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.741716 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.741864 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.742014 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.742237 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.742382 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.742530 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.742671 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.742851 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.743002 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.743157 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.743157 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.743424 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.743577 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.743729 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.743889 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.744111 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.744280 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.744429 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.744571 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.744712 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.744853 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.745003 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.745145 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.745286 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.745426 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.745576 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.745726 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.745868 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.745868 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.746188 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.746330 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.746470 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.746470 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.746746 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.746746 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.747043 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.747184 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.747325 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.747492 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.747635 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.747776 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.747925 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.748066 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.748206 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.748356 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.748505 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.748646 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.748787 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.748927 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.749076 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.749217 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.749377 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.749528 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.749678 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.749820 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.749969 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.750110 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.750252 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.750410 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.750622 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.750768 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.750975 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.751119 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.751277 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.751420 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.751560 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.751706 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.751856 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.751998 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.752138 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.752366 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.752516 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.752695 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.753097 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.753267 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.753415 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.753574 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.753718 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.753867 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.754009 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.754239 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.754395 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.754550 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.754694 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.754887 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.755038 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.755181 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.755328 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.755470 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.755623 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.755774 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.755926 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.756110 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.756257 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.756397 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.756546 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.756689 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.756830 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.756971 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.757111 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.757251 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.757400 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.757554 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.757695 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.757836 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.757984 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.758126 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.758274 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.758416 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.758556 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.758704 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.758926 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.759087 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.759239 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.759391 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.759533 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.759673 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.759814 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.759964 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.760106 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.760258 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.760400 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.760540 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.760773 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.760931 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.761082 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.761225 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.761375 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.761516 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.761656 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.761805 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.761948 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.762097 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.762238 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.762385 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.762527 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.762676 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.762842 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.762991 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.763132 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.763287 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.763429 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.763582 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.763724 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.763864 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.764006 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.764164 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.764403 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.764551 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.764693 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.764833 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.764974 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.765114 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.765273 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.765415 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.765562 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.765704 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.765845 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.765984 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.766182 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.766331 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.766479 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.766621 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.766762 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.766942 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.767097 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.767252 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.767393 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.767534 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.767715 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.767925 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.768070 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.768213 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.768353 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.768493 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.768633 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.768782 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.768932 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.769079 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.769237 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.769386 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.769539 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.769696 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.769844 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.769996 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.770144 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.770292 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.770440 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.770669 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.770930 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.771098 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.771259 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.771409 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.771556 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.771711 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.771711 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.771991 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.772139 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.772286 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.772442 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.772591 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.772738 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.772884 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.772884 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.773172 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.773329 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.773478 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.773625 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.773771 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.773932 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.774081 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.774253 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.774421 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.774643 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.774838 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.774995 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.775143 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.775314 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.775465 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.775613 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.775767 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.775916 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.776072 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.776265 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.776420 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.776567 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.776722 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.776871 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.777026 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.777182 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.777347 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.777504 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.777652 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.777799 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.777955 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.778103 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.778250 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.778396 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.778543 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.778699 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.778883 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.779047 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.779196 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.779361 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.779510 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.779671 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.779821 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.779969 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.780115 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.780262 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.780409 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.780569 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.780745 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.780913 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.781134 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.781305 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.781462 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.781619 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.781775 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.781926 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.782073 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.782220 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.782368 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.782523 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.782672 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.782875 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.783033 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.783192 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.783872 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.784025 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.784182 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.784338 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.784488 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.784654 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.784885 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.785041 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.785189 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.785336 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.785490 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.785638 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.785795 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.785954 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.786103 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.786256 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.786454 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.786602 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.786758 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.786944 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.787097 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.787252 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.787252 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.787541 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.787689 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.787835 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.787835 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.788126 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.788274 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.788429 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.788577 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.788740 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.788906 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.789064 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.789221 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.789368 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.789532 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.789689 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.789862 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.790011 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.790168 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.790317 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.790464 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.790619 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.790768 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.790969 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.791137 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.791371 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.791526 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.791684 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.791832 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.791990 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.792151 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.792306 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.792456 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.792612 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.792769 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.792924 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.793084 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.793233 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.793389 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.793582 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.793762 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.793912 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.794082 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.794242 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.794406 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.794557 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.794705 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.794943 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.795112 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.795262 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.795486 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.795645 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.795794 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.795942 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.796097 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.796257 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.796461 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.796632 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.796789 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.796986 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.797142 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.797289 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.797446 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.797596 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.797743 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.797890 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.798044 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.798218 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.798369 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.798523 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.798673 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.798862 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.799075 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.799236 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.799515 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.799692 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.799844 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.799991 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.800139 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.800299 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.800458 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.800618 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.800768 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.800768 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.801047 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.801211 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.801379 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.801601 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.801756 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.801912 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.802074 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.802230 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.802379 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.802536 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.802685 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.802857 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.803029 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.803179 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.803335 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.803483 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.803630 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.803821 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.803982 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.804131 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.804288 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.804447 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.804595 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.804742 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.804899 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.805139 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.805293 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.805451 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.805600 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.805762 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.805917 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.806074 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.806222 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.806376 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.806579 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.806743 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.806938 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.807088 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.807247 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.807396 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.807553 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.807711 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.807867 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.808030 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.808180 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.808334 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.808482 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.808649 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.808805 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.808954 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.809109 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.809258 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.809414 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.809414 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.809710 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.809858 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.810012 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.810012 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.810308 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.810458 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.810625 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.810784 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.810964 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.811113 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.811274 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.811424 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.811603 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.811603 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.811979 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.812141 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.812301 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.812460 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.812609 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.812776 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.812926 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.813082 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.813231 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.813387 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.813536 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.813692 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.813847 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.814004 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.814154 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.814313 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.814463 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.815535 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.815766 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.815935 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.816094 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.816243 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.816391 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.816539 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.816739 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.816897 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.817047 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.817194 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.817341 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.817489 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.817657 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.817813 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.817961 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.818109 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.818257 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.818403 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.818560 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.818709 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.818894 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.819047 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.819194 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.819342 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.819498 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.819665 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.819814 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.819961 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.820114 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.820263 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.820419 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.820575 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.820725 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.820873 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.821019 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.821175 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.821331 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.821480 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.821638 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.821787 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.822025 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.822193 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.822342 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.822501 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.822650 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.822846 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.823014 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.823172 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.823321 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.823475 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.823623 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.823783 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.823938 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.824096 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.824252 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.824400 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.824547 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.824701 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.824857 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.825019 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.825169 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.825315 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.825489 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.825728 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.825960 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.826112 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.826260 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.826407 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.826554 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.826742 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.826928 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.827080 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.827229 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.827383 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.827532 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.827679 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.827847 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.827998 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.828145 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.828292 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.828440 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.828587 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.828748 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.828897 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.829046 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.829193 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.829193 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.829485 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.829634 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.829792 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.829940 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.830088 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.830781 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.831067 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.831225 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.831373 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.831527 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.831684 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.831832 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.832005 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.832164 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.832324 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.832472 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.832619 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.832779 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.832937 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.833086 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.833242 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.833242 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.833242 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.833664 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.833813 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.833960 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.834106 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.834264 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.834412 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.834567 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.834715 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.834895 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.835049 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.835197 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.835357 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.835515 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.835664 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.835900 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.836057 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.836205 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.836372 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.836531 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.836687 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.836879 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.837032 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.837179 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.837335 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.837485 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.837640 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.837808 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.837956 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.838103 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.838264 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.838431 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.838588 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.838736 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.838930 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.839079 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.839238 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.839387 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.839535 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.839681 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.839829 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.839976 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.840131 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.840290 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.840445 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.840594 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.840748 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.840906 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.841055 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.841208 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.841356 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.841502 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.841650 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.841650 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.841970 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.842137 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.842301 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.842449 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.842596 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.842744 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.842919 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843039 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843141 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843230 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843315 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843407 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843493 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843586 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843671 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843754 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843836 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843918 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.843999 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.844090 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.844184 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.844275 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.844367 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.844452 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.844547 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.844634 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.844723 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.844723 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.844875 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.844964 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.845056 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.845145 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.845229 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.845311 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.845393 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.845393 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.845554 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.845648 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.845781 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.845874 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.845962 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846044 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846116 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846322 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846396 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846466 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846536 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846615 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846689 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846759 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846856 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846930 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.846999 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.847108 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.847184 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.847263 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.847334 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.847458 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.847609 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.847789 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.847942 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.848090 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.848238 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.848385 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.848532 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.848689 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.848849 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.848998 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.849145 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.849292 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.849591 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.849759 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.849916 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.850066 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.850213 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.850360 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.850516 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.850666 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.850867 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.851036 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.851185 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.851333 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.851492 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.851642 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.851790 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.851937 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.852094 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.852251 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.852409 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.852559 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.852706 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.852864 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.853012 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.853169 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.853319 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.853467 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.853613 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.853767 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.853916 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.854072 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.854222 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.854369 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.854516 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.854663 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.854838 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.855007 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.855157 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.855308 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.855455 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.855602 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.855758 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.855915 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.856120 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.856276 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.856432 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.856580 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.856738 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.856899 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.857053 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.857205 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.857354 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.857501 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.857700 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.857854 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.858002 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.858150 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.858297 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.858453 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.858610 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.858769 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.858967 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.859124 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.859274 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.859432 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.859599 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.859821 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.859974 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.860122 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.860269 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.860425 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.860583 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.860732 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.860890 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.861038 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.861185 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.861379 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.861603 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.861759 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.861916 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.862065 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.862213 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.862409 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.862561 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.862561 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.862863 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.863029 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.863190 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.863347 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.863505 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.863654 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.863808 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.863957 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.864113 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.864269 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.864418 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.864565 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.864713 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.864860 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.865031 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.865180 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.865327 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.865474 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.865620 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.865768 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.865924 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.866073 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.866073 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.866360 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.866515 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.866664 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.866877 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.867041 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.867041 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.867326 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.867472 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.867634 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.867827 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.867982 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.868130 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.868285 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.868441 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.868602 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.868751 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.868917 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.869073 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.869230 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.869379 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.869612 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.869763 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.870002 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.870159 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.870308 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.870465 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.870615 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.870763 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.870952 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.871104 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.871263 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.871423 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.871573 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.871721 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.871869 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.872017 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.872177 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.872327 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.872489 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.872649 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.872805 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.872954 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.873112 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.873267 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.873416 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.873574 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.873723 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.873879 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.874029 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.874178 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.874325 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.874490 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.874640 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.874850 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.875018 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.875170 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.875317 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.875464 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.875611 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.875773 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.875923 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.876071 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.876226 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.876375 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.876614 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.876774 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.876928 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.877591 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.878033 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.878198 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.878359 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.878540 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.878694 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.878876 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.879042 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.879201 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.879371 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.879371 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.879662 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.879810 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.879957 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.880209 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.880372 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.880372 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.880655 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.880804 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.880959 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.881122 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.881279 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.881440 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.881589 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.881744 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.881892 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.882049 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.882198 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.882344 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.882493 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.882641 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.882835 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.883006 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.883165 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.883325 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.883482 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.883632 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.883788 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.883937 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.884084 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.884233 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.884380 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.884527 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.884689 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.884839 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.884987 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.884987 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.885288 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.885444 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.885607 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.885757 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.885912 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.886061 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.886209 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.886356 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.886513 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.886662 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.886850 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.887006 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.887167 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.887336 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.887498 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.887657 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.887814 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.887970 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.888158 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.888322 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.888472 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.888621 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.888777 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.888927 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.889083 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.889083 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.889389 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.889546 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.889694 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.889850 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.890008 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.890184 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.890416 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.890579 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.890736 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.890936 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.891097 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.891246 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.891414 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.891564 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.891711 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.891859 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.892016 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.892173 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.892322 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.892469 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.892685 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.893410 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.893556 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.893650 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.893735 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.893849 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.893943 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.894030 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.894030 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.894193 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.894276 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.894358 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.894449 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.894546 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.894631 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.894879 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.894976 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.895195 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.895288 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.895503 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.895598 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.895812 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.895905 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.896119 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.896212 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.896429 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.896522 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.896784 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.896875 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.897092 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.897183 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.897396 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.897489 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.897719 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.897816 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.898020 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.898136 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.898325 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.898432 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.898638 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.898730 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.898973 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.899080 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.899295 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.899518 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.899611 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.899856 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.899949 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.900182 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.900342 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.900568 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.900714 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.900854 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.901051 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.901205 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.901385 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.901552 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.901693 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.901832 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.902019 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.902162 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.902334 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.902476 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.902644 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.902782 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.902979 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.903121 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.903284 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.903444 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.903606 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.903793 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.903959 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.904110 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.904257 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.904406 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.904554 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.904712 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.904861 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.905009 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.905164 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.905314 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.905479 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.905637 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.905787 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.905935 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.906082 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.906230 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.906378 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.906604 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.906758 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.906936 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.907087 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.907235 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.907407 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.907566 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.907723 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.907872 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.908020 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.908168 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.908408 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.908563 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.908563 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.908984 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.909135 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.909283 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.909446 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.909609 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.909767 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.909917 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.910065 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.910212 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.910375 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.910527 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.910764 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.910969 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.911120 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.911285 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.911285 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.911580 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.911750 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.911901 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.912048 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.912211 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.912367 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.912522 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.912672 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.912826 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.912826 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.913117 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.913266 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.913415 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.913576 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.913725 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.913882 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.914032 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.914179 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.914327 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.914474 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.914622 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.914778 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.914953 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.915104 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.915252 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.915410 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.915571 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.915734 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.915883 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.916038 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.916188 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.916336 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.916496 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.916646 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.916794 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.916947 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.917096 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.917244 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.917409 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.917559 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.917706 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.917854 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.918001 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.918149 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.918306 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.918496 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.918649 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.918830 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.918987 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.919136 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.919308 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.919458 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.919613 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.919761 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.919917 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.920079 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.920229 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.920385 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.920533 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.920681 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.920916 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.921081 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.921232 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.921392 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.921541 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.921700 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.921849 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.922007 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.922163 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.922312 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.922470 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.922626 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.922774 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.922962 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.923112 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.923260 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.923419 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.923567 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.923723 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.923911 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.923911 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.924364 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.924364 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.924646 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.924646 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.924948 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.925097 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.925245 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.925392 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.925550 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.925707 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.925864 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.926013 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.926160 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.926315 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.926473 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.926623 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.926770 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.926969 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.927119 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.927266 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.927436 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.927587 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.927742 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.927890 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.928038 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.928186 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.928342 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.928533 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.928690 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.928838 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.928986 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.929142 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.929304 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.929472 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.929630 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.929779 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.929970 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.930138 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.930288 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.930436 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.930591 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.930740 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.930933 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.931170 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.931326 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.931486 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.931651 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.931806 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.931954 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.932112 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.932263 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.932411 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.932559 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.932707 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.932865 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.932865 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.933146 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.933293 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.933451 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.933600 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.933756 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.933907 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.934062 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.934217 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.934365 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.934513 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.934669 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.934890 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.935048 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.935197 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.935356 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.935356 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.935716 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.935865 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.936014 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.936161 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.936316 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.936474 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.936623 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.936770 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.936918 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.937066 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.937233 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.937392 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.937541 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.937689 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.937836 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.937984 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.938133 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.938289 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.938445 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.938637 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.938810 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.938966 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.939128 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.939128 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 00:47:14.939425 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.939425 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.939425 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.939425 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.940593 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.940593 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:47:14.940883 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 00:47:15.092328 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO dbcounter [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Registered counter for database nova_api Sep 18 00:47:15.093164 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO dbcounter [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Registered counter for database nova_api Sep 18 00:47:15.115167 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG oslo_db.sqlalchemy.engines [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:47:15.117148 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_db.sqlalchemy.engines [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:47:15.122019 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writer thread running {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:47:15.123672 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writer thread running {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:47:15.180194 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.context [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb16c1c6-0d79-4315-9c36-c2a3e656bbb3(cell1) {{(pid=105448) load_cells /opt/stack/nova/nova/context.py:464}} Sep 18 00:47:15.181195 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.context [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb16c1c6-0d79-4315-9c36-c2a3e656bbb3(cell1) {{(pid=105449) load_cells /opt/stack/nova/nova/context.py:464}} Sep 18 00:47:15.184016 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:47:15.184491 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:47:15.185058 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:47:15.185531 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:47:15.186051 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:47:15.186783 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:47:15.187083 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:47:15.187254 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:47:15.187805 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:47:15.188253 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:47:15.189231 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:47:15.191205 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:47:15.191811 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO dbcounter [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Registered counter for database nova_cell0 Sep 18 00:47:15.193191 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO dbcounter [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Registered counter for database nova_cell0 Sep 18 00:47:15.195825 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO dbcounter [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Registered counter for database nova_cell1 Sep 18 00:47:15.197288 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO dbcounter [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Registered counter for database nova_cell1 Sep 18 00:47:15.203473 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG oslo_db.sqlalchemy.engines [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:47:15.205709 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG oslo_db.sqlalchemy.engines [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:47:15.206976 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_db.sqlalchemy.engines [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:47:15.209291 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_db.sqlalchemy.engines [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:47:15.210969 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writer thread running {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:47:15.213830 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writer thread running {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:47:15.214300 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writer thread running {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:47:15.219728 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writer thread running {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:47:15.359727 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO dbcounter [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Registered counter for database nova_cell0 Sep 18 00:47:15.362684 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO dbcounter [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Registered counter for database nova_cell0 Sep 18 00:47:15.369168 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG oslo_db.sqlalchemy.engines [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:47:15.371095 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_db.sqlalchemy.engines [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:47:15.374123 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writer thread running {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:47:15.375791 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writer thread running {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:47:15.713550 dv-cinder-master-3-smb devstack@n-api.service[105449]: WARNING keystonemiddleware.auth_token [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:47:15.720138 dv-cinder-master-3-smb devstack@n-api.service[105448]: WARNING keystonemiddleware.auth_token [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:47:15.721460 dv-cinder-master-3-smb devstack@n-api.service[105449]: WARNING keystonemiddleware.auth_token [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:47:15.727962 dv-cinder-master-3-smb devstack@n-api.service[105448]: WARNING keystonemiddleware.auth_token [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:47:16.066910 dv-cinder-master-3-smb devstack@n-api.service[105449]: WARNING keystonemiddleware.auth_token [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:47:16.072845 dv-cinder-master-3-smb devstack@n-api.service[105449]: WARNING keystonemiddleware.auth_token [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:47:16.074928 dv-cinder-master-3-smb devstack@n-api.service[105448]: WARNING keystonemiddleware.auth_token [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:47:16.079094 dv-cinder-master-3-smb devstack@n-api.service[105449]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588277819c0 pid: 105449 (default app) Sep 18 00:47:16.081054 dv-cinder-master-3-smb devstack@n-api.service[105448]: WARNING keystonemiddleware.auth_token [None req-100832ab-be40-4e5f-89f0-9e278c05dca2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:47:16.081290 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:47:16.082475 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Sep 18 00:47:16.082904 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Sun Sep 18 00:47:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:47:16.086307 dv-cinder-master-3-smb devstack@n-api.service[105448]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588277819c0 pid: 105448 (default app) Sep 18 00:48:37.962866 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:48:37.964604 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002259 Sep 18 00:48:37.965248 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:48:37.984469 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_api:SELECT=3 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:37.986239 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_cell0:SELECT=3 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:37.987379 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_cell1:SELECT=3 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:37.988468 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:38.851464 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-0235f0a4-f25e-47c0-9bbc-807c76ac458c admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:48:38.885963 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-0235f0a4-f25e-47c0-9bbc-807c76ac458c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.912290 Sep 18 00:48:38.898822 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1292 bytes} [Sun Sep 18 00:48:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:48:41.563102 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:48:41.564187 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-01cf410b-7d40-47ec-a1d5-9d0cee0b9a4c None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 18 00:48:41.568593 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:48:41 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:48:42.025626 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-c982f64c-8870-4a4f-9ba9-24401dc10324 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "name": "cirros256", "disk": 1, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:48:42.073913 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-c982f64c-8870-4a4f-9ba9-24401dc10324 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.503374 Sep 18 00:48:42.074492 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 18 00:48:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:48:42.088844 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writing DB stats nova_api:SELECT=3 {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:42.089654 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writing DB stats nova_cell0:SELECT=3 {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:42.092532 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writing DB stats nova_cell1:SELECT=3 {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:42.093280 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:42.306872 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-35746378-2306-4c46-adba-bf9b5358db43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:48:42.375699 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-35746378-2306-4c46-adba-bf9b5358db43 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291933 Sep 18 00:48:42.376528 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1336 bytes} [Sun Sep 18 00:48:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:48:45.002397 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-c982f64c-8870-4a4f-9ba9-24401dc10324 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:48:45.003466 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-c982f64c-8870-4a4f-9ba9-24401dc10324 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001780 Sep 18 00:48:45.004120 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:48:45.679217 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-4bf3eab1-7eae-4a50-bf45-c2c512da5a6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "ram": 512, "name": "ds512M"}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:48:45.719631 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-4bf3eab1-7eae-4a50-bf45-c2c512da5a6d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.709306 Sep 18 00:48:45.720514 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 18 00:48:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:48:45.733574 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-7b9eedf9-8da9-47aa-b7c8-7b4bda4834a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:48:45.772967 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-7b9eedf9-8da9-47aa-b7c8-7b4bda4834a1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044094 Sep 18 00:48:45.773541 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1336 bytes} [Sun Sep 18 00:48:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:48:48.409721 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-4bf3eab1-7eae-4a50-bf45-c2c512da5a6d admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:48:48.410704 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-4bf3eab1-7eae-4a50-bf45-c2c512da5a6d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Sep 18 00:48:48.411160 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:48:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:48:48.833427 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-ae062f85-b331-4de8-a4a4-e35c7d780da7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:48:48.852645 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-ae062f85-b331-4de8-a4a4-e35c7d780da7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434637 Sep 18 00:48:48.853211 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 18 00:48:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:48:48.868513 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-b68c74a9-01cc-43d5-9c4c-6a6b14869116 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:48:48.900158 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-b68c74a9-01cc-43d5-9c4c-6a6b14869116 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036567 Sep 18 00:48:48.900743 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1336 bytes} [Sun Sep 18 00:48:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:48:51.587721 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-ae062f85-b331-4de8-a4a4-e35c7d780da7 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:48:51.589363 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-ae062f85-b331-4de8-a4a4-e35c7d780da7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 Sep 18 00:48:51.589748 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:48:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:48:52.107564 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-60875583-af31-485b-99b1-8c25500da8e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:48:52.129633 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-60875583-af31-485b-99b1-8c25500da8e2 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.533424 Sep 18 00:48:52.130884 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 18 00:48:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:48:52.144342 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-3b96385d-028e-453f-955a-3cefb2ba9c26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:48:52.174315 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-3b96385d-028e-453f-955a-3cefb2ba9c26 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033666 Sep 18 00:48:52.178831 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1336 bytes} [Sun Sep 18 00:48:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:48:54.842539 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-60875583-af31-485b-99b1-8c25500da8e2 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:48:54.843653 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-60875583-af31-485b-99b1-8c25500da8e2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001700 Sep 18 00:48:54.844237 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:48:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:48:55.293742 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-0b551f50-d973-4096-a736-c577bb825fef admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "ram": 4096, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:48:55.318160 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-0b551f50-d973-4096-a736-c577bb825fef admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.467758 Sep 18 00:48:55.319163 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 18 00:48:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:48:55.333646 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-250ace5b-56d0-42f7-ab3b-9cf56eaf2d77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:48:55.358748 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-250ace5b-56d0-42f7-ab3b-9cf56eaf2d77 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028754 Sep 18 00:48:55.359360 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1336 bytes} [Sun Sep 18 00:48:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:48:58.042949 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-0b551f50-d973-4096-a736-c577bb825fef admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:48:58.044461 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-0b551f50-d973-4096-a736-c577bb825fef admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002274 Sep 18 00:48:58.045079 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:48:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:48:58.495948 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-6aa914f5-3eba-47fd-9e24-16d62ab231a0 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:48:58.534987 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-6aa914f5-3eba-47fd-9e24-16d62ab231a0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.482626 Sep 18 00:48:58.535753 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1292 bytes} [Sun Sep 18 00:48:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:49:01.537724 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-0b551f50-d973-4096-a736-c577bb825fef admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:01.538654 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-0b551f50-d973-4096-a736-c577bb825fef admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 18 00:49:01.539087 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:49:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:01.939650 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-09872b35-3f03-467f-ba88-4eb65cbf7052 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:01.961757 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-09872b35-3f03-467f-ba88-4eb65cbf7052 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.416515 Sep 18 00:49:01.962501 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 18 00:49:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:49:01.974890 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-b68aca02-33ed-4004-beb4-5fada95ec69c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:02.002989 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-b68aca02-33ed-4004-beb4-5fada95ec69c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031899 Sep 18 00:49:02.004005 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1333 bytes} [Sun Sep 18 00:49:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:49:04.620247 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-09872b35-3f03-467f-ba88-4eb65cbf7052 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:04.621128 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-09872b35-3f03-467f-ba88-4eb65cbf7052 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 18 00:49:04.621521 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:49:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:49:05.006349 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-7dae8596-39da-4ea1-9611-1c82bf17a6c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:05.028813 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-7dae8596-39da-4ea1-9611-1c82bf17a6c3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.400218 Sep 18 00:49:05.029468 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 18 00:49:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:49:05.043450 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-c1186a9c-6ab4-4022-8910-eb85f3a07788 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:05.072066 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-c1186a9c-6ab4-4022-8910-eb85f3a07788 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032364 Sep 18 00:49:05.072924 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1333 bytes} [Sun Sep 18 00:49:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:49:07.723962 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-7dae8596-39da-4ea1-9611-1c82bf17a6c3 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:07.725650 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-7dae8596-39da-4ea1-9611-1c82bf17a6c3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Sep 18 00:49:07.726054 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:49:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:08.185772 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-0dfbfa08-5c6b-4115-95e0-4bef0765b9f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "swap": 0, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:08.208507 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-0dfbfa08-5c6b-4115-95e0-4bef0765b9f5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.474261 Sep 18 00:49:08.209366 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 18 00:49:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 00:49:08.222127 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-894690ee-c3d0-4c87-a8ff-60182181b6fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:08.227288 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:08.256246 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-894690ee-c3d0-4c87-a8ff-60182181b6fd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038425 Sep 18 00:49:08.257081 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1333 bytes} [Sun Sep 18 00:49:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:49:10.886058 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-0dfbfa08-5c6b-4115-95e0-4bef0765b9f5 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:10.887102 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-0dfbfa08-5c6b-4115-95e0-4bef0765b9f5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 18 00:49:10.887757 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:49:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:11.380222 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-010b80f4-c98b-4260-a9b4-a7c94743540c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "disk": 80}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:11.402936 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-010b80f4-c98b-4260-a9b4-a7c94743540c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.508596 Sep 18 00:49:11.406841 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 18 00:49:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:49:11.416824 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-232482af-e825-488a-8b82-bc6fb2463aa6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:11.443318 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-232482af-e825-488a-8b82-bc6fb2463aa6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030107 Sep 18 00:49:11.444244 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1333 bytes} [Sun Sep 18 00:49:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:49:14.137948 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-010b80f4-c98b-4260-a9b4-a7c94743540c admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:14.139041 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-010b80f4-c98b-4260-a9b4-a7c94743540c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Sep 18 00:49:14.139606 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:49:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:14.575703 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-f6bc54f7-729a-4ab7-be51-724ec923a08b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:14.585473 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:14.598481 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-f6bc54f7-729a-4ab7-be51-724ec923a08b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.452424 Sep 18 00:49:14.599326 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 18 00:49:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 00:49:14.611761 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-6a44ae3a-700a-4eb4-b6a2-4ec9dce043ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:14.637374 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-6a44ae3a-700a-4eb4-b6a2-4ec9dce043ee admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029772 Sep 18 00:49:14.637958 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1333 bytes} [Sun Sep 18 00:49:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:49:30.801296 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-f6bc54f7-729a-4ab7-be51-724ec923a08b admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:30.802220 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-f6bc54f7-729a-4ab7-be51-724ec923a08b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 18 00:49:30.802620 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:49:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:30.813599 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:31.191578 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-2f5a629b-bd4d-4eb6-9e6c-cfa25eed331d admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:31.209576 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-2f5a629b-bd4d-4eb6-9e6c-cfa25eed331d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400928 Sep 18 00:49:31.210116 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1292 bytes} [Sun Sep 18 00:49:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:49:32.522835 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-f6bc54f7-729a-4ab7-be51-724ec923a08b admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:32.523837 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-f6bc54f7-729a-4ab7-be51-724ec923a08b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 18 00:49:32.524227 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:49:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:33.051080 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-e052e514-d966-4ac1-a193-bc586a5f16ec admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:33.056380 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.wsgi [None req-e052e514-d966-4ac1-a193-bc586a5f16ec admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-e052e514-d966-4ac1-a193-bc586a5f16ec admin admin] Request method failure captured: Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: Accept: application/json Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: Accept-Encoding: gzip, deflate Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: Connection: keep-alive Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: Content-Length: 0 Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: Host: 10.222.0.33 Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: Openstack-Api-Version: compute 2.92 Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: Openstack-System-Scope: None Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: User-Agent: python-novaclient Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Auth-Token: gAAAAABjJmsc__cWH9VHsvSyeEzzc6NRFTiavcXfgH_h4h8fmJ0kbaXKUJBXlogI91RuUHVW_yLyzvTfHs_Dxf3_SF6B4gRGqh2ttg4eOE6PxwIw78cW9kOVHotPXB0LmhZ7pWUleGfeMju-j9bvRat5P3n94Ou4oiKv3jOl5gLeA8p5oZcEDy4 Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Domain-Id: None Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Domain-Name: None Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Identity-Status: Confirmed Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Is-Admin-Project: True Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Domain-Id: default Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Domain-Name: Default Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Name: admin Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Role: reader,admin,member Sep 18 00:49:33.059639 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Roles: reader,admin,member Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc6c609cf3f84261a2a1675dd3a909f0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}] Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Tenant: admin Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Tenant-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Tenant-Name: admin Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User: admin Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Domain-Id: default Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Domain-Name: Default Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Id: cdced0a6d3574aefb04d566f50497e83 Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Name: admin Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: method: > Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: exception: Flavor 42 could not be found. Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: action_args: {'id': '42'} Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:49:33.061370 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:33.062946 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:33.064350 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-e052e514-d966-4ac1-a193-bc586a5f16ec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:49:33.065607 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-e052e514-d966-4ac1-a193-bc586a5f16ec admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396293 Sep 18 00:49:33.065607 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Sep 18 00:49:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:33.071458 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-ad24f9f2-f33e-432c-bb1d-e4a187761fa9 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:33.095498 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-ad24f9f2-f33e-432c-bb1d-e4a187761fa9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027615 Sep 18 00:49:33.096041 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 18 00:49:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:49:33.106519 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-c78f8834-edab-4936-bdf3-f95d9fae77ba admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:33.129285 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-c78f8834-edab-4936-bdf3-f95d9fae77ba admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027186 Sep 18 00:49:33.129831 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 18 00:49:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:49:33.139706 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-0ee15a87-774e-4a8a-9455-b3a9b41ec1a3 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:33.145766 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.wsgi [None req-0ee15a87-774e-4a8a-9455-b3a9b41ec1a3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-0ee15a87-774e-4a8a-9455-b3a9b41ec1a3 admin admin] Request method failure captured: Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: Accept: application/json Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: Accept-Encoding: gzip, deflate Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: Connection: keep-alive Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: Content-Length: 0 Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: Host: 10.222.0.33 Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: Openstack-Api-Version: compute 2.92 Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: Openstack-System-Scope: None Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: User-Agent: python-novaclient Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Auth-Token: gAAAAABjJmsc__cWH9VHsvSyeEzzc6NRFTiavcXfgH_h4h8fmJ0kbaXKUJBXlogI91RuUHVW_yLyzvTfHs_Dxf3_SF6B4gRGqh2ttg4eOE6PxwIw78cW9kOVHotPXB0LmhZ7pWUleGfeMju-j9bvRat5P3n94Ou4oiKv3jOl5gLeA8p5oZcEDy4 Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Domain-Id: None Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Domain-Name: None Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Identity-Status: Confirmed Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Is-Admin-Project: True Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Domain-Id: default Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Domain-Name: Default Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Name: admin Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Role: reader,admin,member Sep 18 00:49:33.149004 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Roles: reader,admin,member Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc6c609cf3f84261a2a1675dd3a909f0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}] Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Tenant: admin Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Tenant-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Tenant-Name: admin Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User: admin Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Domain-Id: default Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Domain-Name: Default Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Id: cdced0a6d3574aefb04d566f50497e83 Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Name: admin Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: method: > Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: exception: Flavor 42 could not be found. Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: action_args: {'id': '42'} Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:49:33.150412 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:33.151392 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:33.152603 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-0ee15a87-774e-4a8a-9455-b3a9b41ec1a3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:49:33.153657 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-0ee15a87-774e-4a8a-9455-b3a9b41ec1a3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014590 Sep 18 00:49:33.153657 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Sep 18 00:49:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:34.386283 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-c78f8834-edab-4936-bdf3-f95d9fae77ba admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:34.387326 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-c78f8834-edab-4936-bdf3-f95d9fae77ba admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 18 00:49:34.387748 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:34.914629 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-283d506d-b4a2-414a-9d0f-44ccaa095f38 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:34.919634 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.wsgi [None req-283d506d-b4a2-414a-9d0f-44ccaa095f38 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-283d506d-b4a2-414a-9d0f-44ccaa095f38 admin admin] Request method failure captured: Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: Accept: application/json Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: Accept-Encoding: gzip, deflate Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: Connection: keep-alive Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: Content-Length: 0 Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: Host: 10.222.0.33 Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: Openstack-Api-Version: compute 2.92 Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: Openstack-System-Scope: None Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: User-Agent: python-novaclient Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Auth-Token: gAAAAABjJmseI_xBRQivjN7BRmKAkbypEpFSiDimCwqrkCRHqS8at4EB3Vt9aE5vBIUH_diGFL2Cc1NRNHXed-ZFrX9_sxE0sUD-fD_gRoQt5GPGX2fOokHgWyBjuu7rLjsV1fhqnQPRBMRsVnKV05vvq6FoFa4RSzTu0vsDJNE-wbtPtTVtlQE Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Domain-Id: None Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Domain-Name: None Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Identity-Status: Confirmed Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Is-Admin-Project: True Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Domain-Id: default Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Domain-Name: Default Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Name: admin Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Role: reader,admin,member Sep 18 00:49:34.921115 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Roles: reader,admin,member Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc6c609cf3f84261a2a1675dd3a909f0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}] Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Tenant: admin Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Tenant-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Tenant-Name: admin Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User: admin Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Domain-Id: default Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Domain-Name: Default Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Id: cdced0a6d3574aefb04d566f50497e83 Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Name: admin Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: method: > Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: exception: Flavor 84 could not be found. Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: action_args: {'id': '84'} Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:49:34.923533 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:34.924527 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:34.926186 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-283d506d-b4a2-414a-9d0f-44ccaa095f38 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:49:34.927590 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-283d506d-b4a2-414a-9d0f-44ccaa095f38 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.396587 Sep 18 00:49:34.927590 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Sep 18 00:49:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:34.933649 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-d597d104-2e41-47fc-a5de-65de574f8517 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:34.948583 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-d597d104-2e41-47fc-a5de-65de574f8517 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019033 Sep 18 00:49:34.949104 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 18 00:49:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:49:34.959609 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-7dd43cac-ff19-4b2c-9aa2-0617637e8795 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:34.976287 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-7dd43cac-ff19-4b2c-9aa2-0617637e8795 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020119 Sep 18 00:49:34.976832 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 18 00:49:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:49:34.986465 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-06e2737e-723b-46e0-b7ce-e4c65190fbfe admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:34.991678 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.wsgi [None req-06e2737e-723b-46e0-b7ce-e4c65190fbfe admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-06e2737e-723b-46e0-b7ce-e4c65190fbfe admin admin] Request method failure captured: Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: Accept: application/json Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: Accept-Encoding: gzip, deflate Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: Connection: keep-alive Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: Content-Length: 0 Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: Host: 10.222.0.33 Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: Openstack-Api-Version: compute 2.92 Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: Openstack-System-Scope: None Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: User-Agent: python-novaclient Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Auth-Token: gAAAAABjJmseI_xBRQivjN7BRmKAkbypEpFSiDimCwqrkCRHqS8at4EB3Vt9aE5vBIUH_diGFL2Cc1NRNHXed-ZFrX9_sxE0sUD-fD_gRoQt5GPGX2fOokHgWyBjuu7rLjsV1fhqnQPRBMRsVnKV05vvq6FoFa4RSzTu0vsDJNE-wbtPtTVtlQE Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Domain-Id: None Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Domain-Name: None Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Identity-Status: Confirmed Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Is-Admin-Project: True Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Domain-Id: default Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Domain-Name: Default Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Name: admin Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Role: reader,admin,member Sep 18 00:49:34.993178 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Roles: reader,admin,member Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc6c609cf3f84261a2a1675dd3a909f0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}] Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Tenant: admin Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Tenant-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Tenant-Name: admin Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User: admin Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Domain-Id: default Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Domain-Name: Default Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Id: cdced0a6d3574aefb04d566f50497e83 Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Name: admin Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: method: > Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: exception: Flavor 84 could not be found. Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: action_args: {'id': '84'} Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:49:34.994833 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:34.995844 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:34.997202 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-06e2737e-723b-46e0-b7ce-e4c65190fbfe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:49:34.998448 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-06e2737e-723b-46e0-b7ce-e4c65190fbfe admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011821 Sep 18 00:49:34.998448 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Sep 18 00:49:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:36.210668 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-7dd43cac-ff19-4b2c-9aa2-0617637e8795 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:36.211706 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-7dd43cac-ff19-4b2c-9aa2-0617637e8795 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 18 00:49:36.212099 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:49:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:36.729087 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-3fbdbdb8-0037-486e-8d49-6dfa209244be admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:36.735423 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.wsgi [None req-3fbdbdb8-0037-486e-8d49-6dfa209244be admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-3fbdbdb8-0037-486e-8d49-6dfa209244be admin admin] Request method failure captured: Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: Accept: application/json Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: Accept-Encoding: gzip, deflate Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: Connection: keep-alive Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: Content-Length: 0 Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: Host: 10.222.0.33 Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: Openstack-Api-Version: compute 2.92 Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: Openstack-System-Scope: None Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: User-Agent: python-novaclient Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Auth-Token: gAAAAABjJmsgH7vnjaeXQ-G5BP5eqauGU-AtmvvrpF7uJDtcS_76Xw9A6cCKsIXiTBYsDD0AhxyH7qvEBfwxGAs6ffQJdRuVA_05tVZ-gsJwdanB8haYkoq7rrU85EY3TCE1HLTBAsz9zqo8zrVsOTxaafHZa_Bf8E9XdIbhaBUpH_ONCNbsgU0 Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Domain-Id: None Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Domain-Name: None Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Identity-Status: Confirmed Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Is-Admin-Project: True Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Domain-Id: default Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Domain-Name: Default Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Project-Name: admin Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Role: reader,admin,member Sep 18 00:49:36.736909 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Roles: reader,admin,member Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc6c609cf3f84261a2a1675dd3a909f0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}] Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Tenant: admin Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Tenant-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-Tenant-Name: admin Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User: admin Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Domain-Id: default Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Domain-Name: Default Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Id: cdced0a6d3574aefb04d566f50497e83 Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: X-User-Name: admin Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: method: > Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: exception: Flavor 451 could not be found. Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: action_args: {'id': '451'} Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:49:36.738479 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:36.740554 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Sep 18 00:49:36.741860 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-3fbdbdb8-0037-486e-8d49-6dfa209244be admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:49:36.743174 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-3fbdbdb8-0037-486e-8d49-6dfa209244be admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390335 Sep 18 00:49:36.743174 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 18 00:49:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 18 00:49:36.748043 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-50a24ce3-0df6-4511-b4bd-fd021624f8cd admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:36.763769 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-50a24ce3-0df6-4511-b4bd-fd021624f8cd admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019325 Sep 18 00:49:36.764286 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 18 00:49:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:49:36.773589 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:36.789153 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019064 Sep 18 00:49:36.789668 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 18 00:49:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:49:36.799813 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-ef8ff595-6f76-4d81-9e80-48b22f26c76b admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:36.804726 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.wsgi [None req-ef8ff595-6f76-4d81-9e80-48b22f26c76b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-ef8ff595-6f76-4d81-9e80-48b22f26c76b admin admin] Request method failure captured: Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: Accept: application/json Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: Accept-Encoding: gzip, deflate Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: Connection: keep-alive Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: Content-Length: 0 Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: Host: 10.222.0.33 Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: Openstack-Api-Version: compute 2.92 Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: Openstack-System-Scope: None Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: User-Agent: python-novaclient Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Auth-Token: gAAAAABjJmsgH7vnjaeXQ-G5BP5eqauGU-AtmvvrpF7uJDtcS_76Xw9A6cCKsIXiTBYsDD0AhxyH7qvEBfwxGAs6ffQJdRuVA_05tVZ-gsJwdanB8haYkoq7rrU85EY3TCE1HLTBAsz9zqo8zrVsOTxaafHZa_Bf8E9XdIbhaBUpH_ONCNbsgU0 Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Domain-Id: None Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Domain-Name: None Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Identity-Status: Confirmed Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Is-Admin-Project: True Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Openstack-Nova-Api-Version: 2.92 Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Domain-Id: default Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Domain-Name: Default Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Project-Name: admin Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Role: reader,admin,member Sep 18 00:49:36.806211 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Roles: reader,admin,member Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc6c609cf3f84261a2a1675dd3a909f0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc6c609cf3f84261a2a1675dd3a909f0"}]}] Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Tenant: admin Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Tenant-Id: bc6c609cf3f84261a2a1675dd3a909f0 Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-Tenant-Name: admin Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User: admin Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Domain-Id: default Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Domain-Name: Default Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Id: cdced0a6d3574aefb04d566f50497e83 Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: X-User-Name: admin Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: method: > Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: exception: Flavor 451 could not be found. Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: action_args: {'id': '451'} Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:49:36.807841 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:36.808707 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: ERROR nova.api.openstack.wsgi Sep 18 00:49:36.810069 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-ef8ff595-6f76-4d81-9e80-48b22f26c76b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:49:36.811180 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-ef8ff595-6f76-4d81-9e80-48b22f26c76b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012158 Sep 18 00:49:36.811180 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 18 00:49:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:38.037552 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:38.038570 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 18 00:49:38.039004 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:38.553787 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-0a3f4bcf-7300-403d-92b1-425320deade1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:38.573292 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-0a3f4bcf-7300-403d-92b1-425320deade1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.397026 Sep 18 00:49:38.573826 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Sep 18 00:49:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:49:39.792392 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:39.793396 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 18 00:49:39.793788 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:49:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:40.324896 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-945cc03c-75b5-4ca6-be44-572c9fedd7a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:40.343708 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-945cc03c-75b5-4ca6-be44-572c9fedd7a9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.411750 Sep 18 00:49:40.344998 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Sep 18 00:49:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:49:41.565603 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:41.566605 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 18 00:49:41.567031 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:49:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:42.092712 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-dbfa7e95-ef28-4d20-a8de-a83e0d7a0a39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:42.113167 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-dbfa7e95-ef28-4d20-a8de-a83e0d7a0a39 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.406572 Sep 18 00:49:42.113699 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Sep 18 00:49:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:49:43.336542 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:43.337530 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 18 00:49:43.337919 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:49:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:43.863963 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-b3ae17be-e56e-4ac6-9b41-20eb958b7e71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:49:43.882983 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-b3ae17be-e56e-4ac6-9b41-20eb958b7e71 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.407291 Sep 18 00:49:43.883528 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Sep 18 00:49:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:49:45.101352 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:45.102456 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 18 00:49:45.102963 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:49:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:49:45.620615 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-a47dd4f9-ece4-4ff6-8f51-0399e0e58709 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:49:45.642129 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-a47dd4f9-ece4-4ff6-8f51-0399e0e58709 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400844 Sep 18 00:49:45.642620 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Sun Sep 18 00:49:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:50:42.500429 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:50:42.501396 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-2fd47b3b-dc7c-4fb8-84d4-15bf0a3cda83 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 18 00:50:42.502307 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 18 00:50:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:50:42.513134 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:42.890248 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-f645c232-f06d-4121-8c98-de627a8ee1df admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:50:42.911081 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-f645c232-f06d-4121-8c98-de627a8ee1df admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402629 Sep 18 00:50:42.911622 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1292 bytes} [Sun Sep 18 00:50:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:50:42.932919 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_api:SELECT=14 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:42.936673 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-1098cfee-ccb0-48b3-a5d5-8ae5cd48da8f admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:50:42.944346 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-1098cfee-ccb0-48b3-a5d5-8ae5cd48da8f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012954 Sep 18 00:50:42.944868 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1283 bytes} [Sun Sep 18 00:50:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:50:42.956637 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-327c078f-7081-4a6d-9529-5a7984118623 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:50:42.964018 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-327c078f-7081-4a6d-9529-5a7984118623 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011039 Sep 18 00:50:42.964555 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1286 bytes} [Sun Sep 18 00:50:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:50:42.976787 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-7a1b2256-c92f-4c8e-bd5b-8140664b52d5 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:50:42.984090 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-7a1b2256-c92f-4c8e-bd5b-8140664b52d5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010936 Sep 18 00:50:42.984612 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1286 bytes} [Sun Sep 18 00:50:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:50:42.997174 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-8d2557ba-a48d-4367-9d31-34c546706f4b admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:50:43.004540 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-8d2557ba-a48d-4367-9d31-34c546706f4b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010932 Sep 18 00:50:43.005052 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1283 bytes} [Sun Sep 18 00:50:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:53:55.359094 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-7a1b2256-c92f-4c8e-bd5b-8140664b52d5 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:53:55.360243 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-7a1b2256-c92f-4c8e-bd5b-8140664b52d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Sep 18 00:53:55.360640 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:53:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:53:55.504976 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writing DB stats nova_api:SELECT=6 {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:55.680943 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-76d9ec80-d4a1-4aff-9653-16abbb8c59f3 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:53:55.686892 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-76d9ec80-d4a1-4aff-9653-16abbb8c59f3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:53:55.687375 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-76d9ec80-d4a1-4aff-9653-16abbb8c59f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:53:55.687806 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-76d9ec80-d4a1-4aff-9653-16abbb8c59f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:53:55.688529 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-76d9ec80-d4a1-4aff-9653-16abbb8c59f3 admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:53:55.688984 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-76d9ec80-d4a1-4aff-9653-16abbb8c59f3 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:53:55.689399 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-76d9ec80-d4a1-4aff-9653-16abbb8c59f3 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:53:55.722049 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-76d9ec80-d4a1-4aff-9653-16abbb8c59f3 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.218298 Sep 18 00:53:55.722697 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 18 00:53:55 2022] GET /compute/v2.1/os-services => generated 785 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:53:56.849799 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-7a1b2256-c92f-4c8e-bd5b-8140664b52d5 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:53:56.851130 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-7a1b2256-c92f-4c8e-bd5b-8140664b52d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Sep 18 00:53:56.851525 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:53:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:53:57.066858 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-9cbe1611-87a1-4bf5-970c-c2f0ec99f1e2 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:53:57.070272 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-9cbe1611-87a1-4bf5-970c-c2f0ec99f1e2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:53:57.071794 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-9cbe1611-87a1-4bf5-970c-c2f0ec99f1e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:53:57.072235 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-9cbe1611-87a1-4bf5-970c-c2f0ec99f1e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:53:57.072958 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-9cbe1611-87a1-4bf5-970c-c2f0ec99f1e2 admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:53:57.073405 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-9cbe1611-87a1-4bf5-970c-c2f0ec99f1e2 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:53:57.073822 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-9cbe1611-87a1-4bf5-970c-c2f0ec99f1e2 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:53:57.099589 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-9cbe1611-87a1-4bf5-970c-c2f0ec99f1e2 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.088858 Sep 18 00:53:57.100178 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 18 00:53:57 2022] GET /compute/v2.1/os-services => generated 785 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:54:08.616531 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-7a1b2256-c92f-4c8e-bd5b-8140664b52d5 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:54:08.617539 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-7a1b2256-c92f-4c8e-bd5b-8140664b52d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 18 00:54:08.617932 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:54:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:54:08.760798 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writing DB stats nova_cell0:SELECT=4 {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:54:08.761827 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writing DB stats nova_cell1:SELECT=4 {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:54:08.762427 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG dbcounter [-] [105449] Writing DB stats nova_api:SELECT=8 {{(pid=105449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:54:08.811005 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-e40845db-3bfe-4699-86cc-7f77f22b0e46 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:54:08.814338 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-e40845db-3bfe-4699-86cc-7f77f22b0e46 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:54:08.814839 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-e40845db-3bfe-4699-86cc-7f77f22b0e46 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:54:08.815302 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-e40845db-3bfe-4699-86cc-7f77f22b0e46 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:54:08.816023 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-e40845db-3bfe-4699-86cc-7f77f22b0e46 admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:54:08.816469 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-e40845db-3bfe-4699-86cc-7f77f22b0e46 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:54:08.816893 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-e40845db-3bfe-4699-86cc-7f77f22b0e46 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:54:08.843006 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-e40845db-3bfe-4699-86cc-7f77f22b0e46 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.086388 Sep 18 00:54:08.843440 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 18 00:54:08 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:54:09.952386 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-7a1b2256-c92f-4c8e-bd5b-8140664b52d5 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:54:09.953387 dv-cinder-master-3-smb devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-7a1b2256-c92f-4c8e-bd5b-8140664b52d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 18 00:54:09.953780 dv-cinder-master-3-smb devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 18 00:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:54:10.147514 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG nova.api.openstack.wsgi [None req-8d07712f-5dab-4fc2-9930-d5d30554e718 admin admin] Calling method '>' {{(pid=105449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:54:10.150937 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-8d07712f-5dab-4fc2-9930-d5d30554e718 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:54:10.151418 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-8d07712f-5dab-4fc2-9930-d5d30554e718 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:54:10.151847 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-8d07712f-5dab-4fc2-9930-d5d30554e718 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:54:10.152555 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-8d07712f-5dab-4fc2-9930-d5d30554e718 admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:54:10.153002 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-8d07712f-5dab-4fc2-9930-d5d30554e718 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:54:10.153437 dv-cinder-master-3-smb devstack@n-api.service[105449]: DEBUG oslo_concurrency.lockutils [None req-8d07712f-5dab-4fc2-9930-d5d30554e718 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:54:10.175409 dv-cinder-master-3-smb devstack@n-api.service[105449]: INFO nova.api.openstack.requestlog [None req-8d07712f-5dab-4fc2-9930-d5d30554e718 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.081715 Sep 18 00:54:10.175890 dv-cinder-master-3-smb devstack@n-api.service[105449]: [pid: 105449|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 18 00:54:10 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:55:13.256525 dv-cinder-master-3-smb devstack@n-api.service[105447]: Sun Sep 18 00:55:13 2022 - graceful shutdown triggered... Sep 18 00:55:13.256653 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Sep 18 00:55:13.257442 dv-cinder-master-3-smb devstack@n-api.service[105449]: Gracefully killing worker 2 (pid: 105449)... Sep 18 00:55:13.257806 dv-cinder-master-3-smb devstack@n-api.service[105448]: Gracefully killing worker 1 (pid: 105448)... Sep 18 00:55:13.400395 dv-cinder-master-3-smb devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_api:SELECT=4 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:55:14.256987 dv-cinder-master-3-smb devstack@n-api.service[105447]: worker 1 buried after 1 seconds Sep 18 00:55:14.256987 dv-cinder-master-3-smb devstack@n-api.service[105447]: worker 2 buried after 1 seconds Sep 18 00:55:14.256987 dv-cinder-master-3-smb devstack@n-api.service[105447]: goodbye to uWSGI. Sep 18 00:55:14.258561 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Sep 18 00:55:14.259131 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Sep 18 00:55:14.262295 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Sep 18 00:55:14.275711 dv-cinder-master-3-smb devstack@n-api.service[120674]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 18 00:55:14.278663 dv-cinder-master-3-smb devstack@n-api.service[120674]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 18 00:55:14 2022] *** Sep 18 00:55:14.278663 dv-cinder-master-3-smb devstack@n-api.service[120674]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 18 00:55:14.278663 dv-cinder-master-3-smb devstack@n-api.service[120674]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 18 00:55:14.278663 dv-cinder-master-3-smb devstack@n-api.service[120674]: nodename: dv-cinder-master-3-smb Sep 18 00:55:14.278663 dv-cinder-master-3-smb devstack@n-api.service[120674]: machine: x86_64 Sep 18 00:55:14.278663 dv-cinder-master-3-smb devstack@n-api.service[120674]: clock source: unix Sep 18 00:55:14.278663 dv-cinder-master-3-smb devstack@n-api.service[120674]: pcre jit disabled Sep 18 00:55:14.278663 dv-cinder-master-3-smb devstack@n-api.service[120674]: detected number of CPU cores: 4 Sep 18 00:55:14.278663 dv-cinder-master-3-smb devstack@n-api.service[120674]: current working directory: / Sep 18 00:55:14.278663 dv-cinder-master-3-smb devstack@n-api.service[120674]: detected binary path: /usr/bin/uwsgi-core Sep 18 00:55:14.280024 dv-cinder-master-3-smb devstack@n-api.service[120674]: your processes number limit is 47680 Sep 18 00:55:14.280024 dv-cinder-master-3-smb devstack@n-api.service[120674]: your memory page size is 4096 bytes Sep 18 00:55:14.280024 dv-cinder-master-3-smb devstack@n-api.service[120674]: detected max file descriptor number: 2048 Sep 18 00:55:14.280024 dv-cinder-master-3-smb devstack@n-api.service[120674]: lock engine: pthread robust mutexes Sep 18 00:55:14.280024 dv-cinder-master-3-smb devstack@n-api.service[120674]: thunder lock: enabled Sep 18 00:55:14.280024 dv-cinder-master-3-smb devstack@n-api.service[120674]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 18 00:55:14.280024 dv-cinder-master-3-smb devstack@n-api.service[120674]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 18 00:55:14.319982 dv-cinder-master-3-smb devstack@n-api.service[120674]: Python main interpreter initialized at 0x55fdb16bd9c0 Sep 18 00:55:14.319982 dv-cinder-master-3-smb devstack@n-api.service[120674]: python threads support enabled Sep 18 00:55:14.319982 dv-cinder-master-3-smb devstack@n-api.service[120674]: your server socket listen backlog is limited to 100 connections Sep 18 00:55:14.319982 dv-cinder-master-3-smb devstack@n-api.service[120674]: your mercy for graceful operations on workers is 90 seconds Sep 18 00:55:14.320440 dv-cinder-master-3-smb devstack@n-api.service[120674]: mapped 403077 bytes (393 KB) for 2 cores Sep 18 00:55:14.320440 dv-cinder-master-3-smb devstack@n-api.service[120674]: *** Operational MODE: preforking *** Sep 18 00:55:14.320696 dv-cinder-master-3-smb devstack@n-api.service[120674]: *** uWSGI is running in multiple interpreter mode *** Sep 18 00:55:14.320696 dv-cinder-master-3-smb devstack@n-api.service[120674]: spawned uWSGI master process (pid: 120674) Sep 18 00:55:14.320903 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Sep 18 00:55:14.321466 dv-cinder-master-3-smb devstack@n-api.service[120674]: spawned uWSGI worker 1 (pid: 120686, cores: 1) Sep 18 00:55:14.321977 dv-cinder-master-3-smb devstack@n-api.service[120674]: spawned uWSGI worker 2 (pid: 120687, cores: 1) Sep 18 00:55:14.322260 dv-cinder-master-3-smb devstack@n-api.service[120674]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 18 00:55:14.988254 dv-cinder-master-3-smb devstack@n-api.service[120687]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 18 00:55:14.989176 dv-cinder-master-3-smb devstack@n-api.service[120686]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 18 00:55:16.156734 dv-cinder-master-3-smb devstack@n-api.service[120686]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:55:16.156734 dv-cinder-master-3-smb devstack@n-api.service[120686]: from cryptography.utils import int_from_bytes Sep 18 00:55:16.157464 dv-cinder-master-3-smb devstack@n-api.service[120686]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:55:16.157464 dv-cinder-master-3-smb devstack@n-api.service[120686]: from cryptography.utils import int_from_bytes Sep 18 00:55:16.166696 dv-cinder-master-3-smb devstack@n-api.service[120687]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:55:16.166696 dv-cinder-master-3-smb devstack@n-api.service[120687]: from cryptography.utils import int_from_bytes Sep 18 00:55:16.167201 dv-cinder-master-3-smb devstack@n-api.service[120687]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:55:16.167201 dv-cinder-master-3-smb devstack@n-api.service[120687]: from cryptography.utils import int_from_bytes Sep 18 00:55:18.615691 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 00:55:18.616310 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 00:55:18.616510 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 00:55:18.616878 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 00:55:18.617137 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 00:55:18.617534 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.617864 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.618188 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.618512 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.618874 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.619194 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.619521 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.619844 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.620176 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.620440 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.620756 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.621561 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.621893 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.622212 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.622534 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.622886 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.623206 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.623536 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.623848 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.624363 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.625114 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.625433 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.625750 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.626100 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.626424 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.626741 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.627104 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.627420 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.627754 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.628086 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.628487 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.628814 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.629133 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.629456 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.629886 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.630199 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.630513 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.630875 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.631211 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.631524 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.631855 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.632177 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.632498 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.632820 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.633132 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.633443 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.633755 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.634075 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.634382 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.634688 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.635232 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.635543 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.635866 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.636188 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.637136 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.637899 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.638117 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.638480 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.638918 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.639199 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.639535 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.639866 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.640191 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.640517 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.640844 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.641164 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.641484 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.641820 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.642153 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.642487 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.642844 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.643165 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.643591 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.643854 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.644174 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.644532 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.644859 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.645179 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.645510 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.645841 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.646161 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.646480 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.646818 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.647149 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.647500 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.647822 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.648071 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.648391 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.648701 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.649029 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.649345 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.649658 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.649971 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.650280 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.650596 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.650933 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.651248 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.651564 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.651875 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.652301 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.653287 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.653586 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.653898 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.654212 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.654546 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.654918 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.655223 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.655541 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.655858 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.656173 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.656505 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.656821 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.657136 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.657469 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.657788 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.658099 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.658431 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.658743 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.659079 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.659405 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.659712 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.660026 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.660351 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.660669 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.660983 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.661294 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.661604 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.661918 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.662230 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.662539 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.662871 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.663179 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.663505 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.663832 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.664150 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.664463 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.664774 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.665101 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.665449 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.665785 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.666137 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.666457 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.666818 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.667153 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.667480 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.667856 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.668326 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.668679 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.669103 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.669427 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.669748 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.670076 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.670404 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.670740 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.671120 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.671433 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.671759 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.672079 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.672408 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.672744 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.673079 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.673400 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.673753 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.674109 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.674436 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.674767 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.675125 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.675448 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.675765 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.676082 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.676431 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.676755 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.677072 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.677399 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.677549 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 00:55:18.678036 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.678183 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 00:55:18.678326 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.678475 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 00:55:18.678623 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.678837 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 00:55:18.678946 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.679043 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 00:55:18.679139 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.679235 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.679332 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.679517 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.679619 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.679836 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.679940 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.680156 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.680266 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.680483 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.680579 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.680846 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.681166 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.681273 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.681525 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.681643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.681817 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.681916 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.682136 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.682313 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.682475 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.682568 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.682767 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.682888 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.683108 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.683325 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.683984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.684273 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.684522 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.684759 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.684921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.685083 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.685235 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.685387 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.685543 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.685709 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.685862 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.686014 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.686160 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.686938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.687039 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.687118 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.687221 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.687299 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.687383 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.687485 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.687575 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.687662 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.687821 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.687912 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.688007 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.688102 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.689231 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.689443 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.689608 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.689767 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.689919 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.690068 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.690221 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.690387 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.690537 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.690678 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.690842 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.690842 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.691028 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.691127 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.691216 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.691312 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.691424 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.691521 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.691622 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.691715 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.691812 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.691907 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.691994 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.692086 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.692280 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.692412 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.692601 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.692699 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.692932 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.693042 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.693239 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.693340 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.693563 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.693667 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.693880 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.693984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.694196 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.694292 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.694512 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.694608 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.694831 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.694949 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.695142 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.695245 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.695448 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.695543 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.695755 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.695849 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.696053 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.696154 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.696356 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.696514 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.696673 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.696824 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.696976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.697123 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.697264 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.697403 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.697561 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.697711 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.697868 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.698020 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.698164 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.698322 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.698464 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.698605 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.698743 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.698912 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.699051 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.699921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.700151 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.700338 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.700490 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.700490 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.700785 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.700926 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.701082 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.701229 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.701376 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.701515 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.701656 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.701797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.701962 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.702108 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.702257 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.702481 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.702628 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.702775 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.702911 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.703008 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.703008 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.703164 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.703314 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.703442 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.703632 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.703726 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.703946 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.704040 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.704248 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.704360 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.704574 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.704678 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.704888 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.704984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.705193 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.705298 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.705509 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.705612 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.705826 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.705921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.706131 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.706236 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.706436 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.706590 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.706733 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.706912 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.707085 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.707243 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.707401 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.707540 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.707694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.707835 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.707983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.708133 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.708282 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.708432 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.708574 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.708712 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.708862 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.709002 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.709154 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.709293 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.709461 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.709614 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.709770 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.709910 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.710049 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.710188 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.710327 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.710500 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.710697 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.710911 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.711056 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.711166 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.711437 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.711599 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.711760 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.711884 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.712074 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.712193 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.712400 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.715521 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.715624 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.715711 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.715793 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.715878 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.715954 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.716040 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.718842 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.719090 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.719511 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.719687 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.719849 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.720070 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.720223 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.720378 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.720535 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.720704 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.720853 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.720999 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.721143 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.721299 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.721459 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.721712 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.721876 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.722031 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.722184 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.722344 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.722344 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.722634 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.722807 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.722972 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.723120 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.723278 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.723441 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.723681 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.723834 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.723988 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.724148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.724303 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.724461 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.724613 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.724759 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.724912 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.725067 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.725222 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.725376 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.725536 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.725690 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.725844 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.726005 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.726151 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.726303 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.726457 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.726665 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.726973 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.727138 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.727292 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.727438 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.727590 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.727746 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.727891 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.728051 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.728216 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.728460 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.728647 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.728815 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.729031 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.729194 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.729369 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.729736 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.729891 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.730045 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.730217 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.730470 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:55:18.730805 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.730964 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.731142 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.731363 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.731527 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.731694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.731925 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.732077 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.732230 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.732383 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.732556 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.732710 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.732863 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.733016 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.733161 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.733307 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.733470 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.733616 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.733850 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.734012 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.734167 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.734329 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.734483 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.734649 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.734815 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.734968 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.735124 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.735286 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.735443 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.735590 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.735735 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.735887 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.736032 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.736187 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.736341 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.736507 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.736704 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.736855 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.737086 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.737252 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.737252 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.737656 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.737851 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.738014 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.738170 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.738317 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.738480 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.738713 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.738910 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.739153 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.739323 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.739478 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.739867 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.740026 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.740182 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.740338 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.740491 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.740646 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.740803 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.740958 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.741103 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.741260 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.741414 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.741567 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.741713 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.741867 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.742115 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.742274 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.742420 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.742572 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.742718 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.742901 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.742901 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.743188 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.743343 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.743496 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.743650 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.743807 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.744054 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.744208 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.744361 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.744507 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.744665 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.744820 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.744966 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.745111 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.745266 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.745411 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.745565 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.745710 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.745855 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.746514 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.746743 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.747012 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.747265 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.747418 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.747563 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.747706 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.747858 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.748118 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.748281 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.748436 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.748589 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.748753 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.748984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.749163 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.749163 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.749517 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.749672 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.749972 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.750144 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.750460 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.750634 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.750813 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.750977 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.751133 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.751279 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.751433 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.751579 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.751731 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.751876 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.752020 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.752260 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.752427 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.752573 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.752726 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.752879 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.753031 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.753187 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.753332 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.753477 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.753621 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.753765 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.753910 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.754672 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.754852 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.755017 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.755186 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.755343 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.755489 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.755643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.755798 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.755944 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.756097 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.756097 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.756379 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.756538 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.756691 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.756892 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.757043 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.757198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.757452 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.757612 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.757773 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.758042 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.758216 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.758365 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.758520 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.758674 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.758882 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.759042 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.759188 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.759332 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.759593 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.760227 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.760409 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.760656 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.760811 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.760956 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.761115 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.761270 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.761415 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.761608 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.762282 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.762516 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.762669 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.762863 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.763016 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.763161 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.763318 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.763473 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.763636 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.763789 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.763943 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.764087 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.764333 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.764493 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.764648 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.764807 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.764954 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.765288 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.765450 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.765606 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.765753 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.765898 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.766060 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.766217 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.766377 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.766532 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.766689 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.766907 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.767086 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.767233 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.767392 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.767641 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.767801 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.771731 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.771919 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.772080 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.772256 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.772420 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.772420 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.772748 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.772748 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.773069 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.773069 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.773358 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.773505 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.773658 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.773811 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.773970 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.774118 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.774264 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.774431 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.774578 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.774732 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.774950 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.775110 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.775287 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.775435 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.775580 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.775580 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.775872 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.776026 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.776172 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.776789 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.776994 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.777148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.777311 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.777459 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.777643 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.777795 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.777956 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.778197 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.778441 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.778609 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.778766 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.778956 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.779112 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.779269 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.779426 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.779573 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.779824 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.779979 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.780132 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.780450 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.780613 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.780764 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.780909 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.781056 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.781201 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.781361 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.781521 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.781521 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.781914 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.782088 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.782289 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.782438 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.782585 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.782731 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.782911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.782911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.782911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.782911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.782911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.783617 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.783769 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.783917 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.784082 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.784082 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.784376 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.784525 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.784670 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.784815 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.784969 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.785116 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.785298 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.785453 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.785598 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.785743 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.785902 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.786066 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.786213 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.786358 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.786503 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.786656 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.787003 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.787204 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.787361 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.787507 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.787659 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.787816 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.787962 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.788258 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.788442 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.788661 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.788823 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.788985 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.789131 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.789285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.789439 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.789594 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.789846 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.790082 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.790234 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.790411 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.790714 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.790892 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.790892 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.791191 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.791346 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.791492 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.791645 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.791799 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.792056 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.792218 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.792373 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.792519 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.792664 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.792845 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.793007 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.793198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.793397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.793397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.793685 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.793836 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.793991 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794139 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794290 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794435 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794580 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.794738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.795869 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.795869 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.795869 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.795869 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.795869 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.796550 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.796713 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.796859 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.797220 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.797375 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.797598 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.797748 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.797894 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.798053 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.798200 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.798200 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.798493 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.798656 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.798921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.799086 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.799233 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.799395 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.799543 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.799696 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.799850 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.799995 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.800240 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.800404 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.800565 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.800881 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.801035 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.801192 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.801339 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.801495 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.801641 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.801786 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.801931 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.802101 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.802350 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.802520 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.802670 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.802906 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.803070 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.803233 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.803379 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.803533 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.803679 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.803832 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.803832 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.804130 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.804276 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.804429 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.804575 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.804737 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.804884 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.805029 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.805184 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.805329 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.805474 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.805629 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.805774 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.805926 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.806079 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.806233 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.806379 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.806532 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.806686 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.806851 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.807044 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.807393 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.807547 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.807708 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.807863 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.808017 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.808164 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.808164 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.809055 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.809210 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.809364 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.809551 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.809853 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.810003 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.810174 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.810417 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.810567 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.810724 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.811055 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.811210 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.811371 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.811518 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.811663 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.811816 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.811972 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.812134 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.812294 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.812569 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.812731 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.812884 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.813038 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.813199 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.813370 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.813634 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.813801 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.813951 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.814098 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.814253 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.814407 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.814571 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.814718 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.814911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.814911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.815208 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.815355 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.815501 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.815654 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.815800 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.816016 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.816165 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.816325 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.816478 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.816635 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.816780 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.816959 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.817208 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.817558 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.817712 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.817874 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.818021 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.818183 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.818338 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.818582 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.818764 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.818947 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.819219 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.819382 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.819529 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.819683 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.819683 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.819966 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.820125 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.820281 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.820452 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.820682 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.820834 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.821142 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.821318 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.821486 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.821633 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.821778 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.821941 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.822162 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.822337 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.822488 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.822738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.822911 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.823070 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.823223 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.823379 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.823544 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.823698 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.823844 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.824015 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.824715 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.825004 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.825169 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.825316 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.825470 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.825665 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.825826 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.825974 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.826128 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.826128 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.826431 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.826585 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.826744 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.826929 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.827077 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.827234 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.827387 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.827734 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.827904 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.828060 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.828207 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.828361 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.828525 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.828746 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.828895 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.829048 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.829222 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.829443 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.829594 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.829751 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.829907 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.830053 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.830200 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.830344 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.830497 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.830691 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.830941 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.831106 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.831428 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.831596 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.831757 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.831757 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.832044 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.832198 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.832356 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.832356 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.832651 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.832938 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.833108 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.833262 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.833421 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.833590 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.833743 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.833904 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.834065 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.834217 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.834369 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.834533 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.834687 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.834908 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.835091 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.835091 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.835401 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.835554 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.835714 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.835876 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.836035 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.836196 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.836358 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.836519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.836672 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.836831 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.836984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.837148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.837148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.837458 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.837638 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.838046 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.838219 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.838373 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.838535 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.838704 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.838890 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.839048 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.839203 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.839379 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.839651 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.839814 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.839968 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.840129 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.840285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.840285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.840597 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.840763 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.840952 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.841192 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.841371 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.841698 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.841875 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.842028 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.842180 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.842333 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.842494 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.842652 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.842830 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.843107 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.843268 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.843268 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.843577 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.843730 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.843902 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.844063 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.844216 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.844377 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.844544 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.844706 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.844859 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.845019 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.845172 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.845338 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.845499 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.845499 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.846172 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.846336 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.846499 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.846662 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.846889 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.847051 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.847214 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.847377 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.847531 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.847692 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.848031 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.848201 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.848355 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.848519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.848687 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.848848 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.849001 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.849265 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.849426 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.849604 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.849604 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.849999 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.850160 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.850314 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.850465 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.850639 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.850823 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.850997 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.851177 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.851401 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.851711 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.851880 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.852044 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.852206 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.852359 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.852511 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.852664 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.852893 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.853070 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.853249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.853499 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.853666 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.853821 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.853989 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.854150 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.854304 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.854456 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.854607 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.854766 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.855042 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.855198 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.855392 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.855556 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.855709 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.855867 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.856034 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.856195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.856195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.856540 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.856695 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.856867 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.857022 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.857182 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.857333 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.857539 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.857698 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.858176 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.858339 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.858492 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.858683 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.858865 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.859033 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.859201 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.859355 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.859515 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.859718 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.859979 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.860149 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.860312 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.860312 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.860622 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.860777 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.860930 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.861091 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.861253 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.861425 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.861825 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.861988 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.862149 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.862324 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.862486 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.862626 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.862720 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.862877 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.863016 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.863120 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.863219 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.863317 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.863406 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.863509 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.863730 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.863870 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.863985 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.864106 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.864220 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.864340 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.864470 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.864593 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.864707 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.864820 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.864932 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.865044 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.865170 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.865292 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.865406 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.865518 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.865640 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.865776 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.865905 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.866026 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.866147 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.866260 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.866381 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.866381 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.866610 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.866731 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.866879 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.866999 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.867113 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.867234 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.867355 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.867476 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.867590 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.867710 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.867831 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.867958 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.868097 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.868394 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.868510 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.868622 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.868734 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.868860 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.868975 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.869087 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.869199 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.869311 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.869421 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.869544 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.869666 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.869779 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.869779 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.870089 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.870221 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.870336 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.870464 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.870464 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.870690 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.871505 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.871670 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.872017 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.872138 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.872258 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.872373 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.872493 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.872620 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.872744 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.872859 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.872971 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873082 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873194 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873320 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873440 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873553 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873665 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873665 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873665 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873665 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873665 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873665 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.873665 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.874489 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.874617 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.874617 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.874870 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.875023 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.875143 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.875266 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.875391 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.875513 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.875626 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.875745 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.875895 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.876032 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.876147 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.876258 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.876376 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.876497 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.876610 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.876736 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.876736 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.876956 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877068 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877186 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877300 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877424 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877538 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877649 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877760 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877871 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.877983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.878697 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.878858 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.879022 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.879155 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.879269 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.879381 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.879491 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.879680 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.879796 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.879916 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.880038 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.880229 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.880351 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.880479 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.880600 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.880714 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.880825 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.880949 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.881064 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.881187 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.881302 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.881414 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.881621 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.881750 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.881892 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.882224 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.882341 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.882463 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.882577 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.882689 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.882834 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.882968 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.883093 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.883206 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.883326 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.883446 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.883569 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.883692 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.883812 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.884030 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.884159 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.884289 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.884289 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.884508 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.884628 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.884991 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.885118 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.885246 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.885369 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.885483 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.885595 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.885707 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.885819 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.885950 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.886065 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.886201 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.886322 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.886434 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.887188 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.887324 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.887441 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.887554 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.887673 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.887787 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.887908 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.888029 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.888144 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.888264 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.888561 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.888700 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.888816 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.888936 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.889057 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.889178 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.889292 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.889423 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.889546 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.889660 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.889772 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.889891 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.890013 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.890140 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.890255 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.890367 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.890487 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.890609 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.890729 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.890893 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.891026 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.891147 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.891268 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.891388 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.891511 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.891643 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.891831 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.891949 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.892274 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.892408 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.892408 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.892638 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.892761 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.892882 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.892882 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.893091 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.893212 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.893325 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.893438 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.893564 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.893686 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.893799 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.893922 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.894061 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.894273 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.894399 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.894512 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.894638 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.894752 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.894920 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.895045 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.895156 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.895280 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.895409 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.895524 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.895644 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.895757 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.895876 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.895989 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.896110 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.896232 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.896353 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.896481 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.896601 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.896714 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.896836 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.896957 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.897071 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.897071 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.897288 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.897412 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.897526 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.897648 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.897769 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.897769 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.897986 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.898113 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.898234 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.898346 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.898457 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.898756 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.898912 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.899048 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.899162 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.899282 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.899403 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.899524 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.899650 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.899765 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.899877 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.899989 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.900100 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.900211 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.900332 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.900446 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.900565 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.900679 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.900679 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.900907 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.901036 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.901158 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.901272 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.901383 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.901550 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.901687 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.901820 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.902008 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.902168 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.902491 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.902622 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.902746 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.902919 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.903040 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.903154 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.903274 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.903394 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.903516 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.903639 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.903760 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.903874 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.903994 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.904107 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.904327 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.904539 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.904657 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.904785 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.904907 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.905030 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.905143 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.905256 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.905375 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.905488 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.905607 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.905729 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.905843 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.905955 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.906074 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 00:55:18.906195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.906195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.906195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.906195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.906195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.906195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.906195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.906195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.907981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.908995 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.908995 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.908995 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.908995 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.908995 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.908995 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.908995 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.908995 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.909886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.909886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.909886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.909886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.909886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.909886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.909886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.910604 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.910604 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.910874 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.911008 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.911309 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.911639 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.911951 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.912256 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.912681 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.912994 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.913312 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.913695 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.913940 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.914262 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.914605 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.914914 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.915237 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.915552 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.915882 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.916334 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.916670 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.917646 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.917646 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.917646 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.918058 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.918219 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.918536 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.918989 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.919439 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.919761 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.920265 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.920698 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.921093 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.921476 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.921852 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.922236 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.922736 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.922997 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.923373 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.923748 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.924124 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.924503 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.924886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.925259 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.925656 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.926029 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.926404 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.926777 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.927204 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.927609 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.927993 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.928386 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.928769 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.929163 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.929541 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.929935 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.930332 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.930662 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.931000 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.931340 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.931661 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.931974 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.932373 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.932947 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.933272 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.934234 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.934577 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.934925 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.935237 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.935572 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.935894 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.936219 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.936537 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.936849 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.937178 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.937487 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.937796 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.938111 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.938422 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.938732 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.939094 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.939386 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.939694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.940009 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.940326 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.940655 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.940978 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.941287 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.941614 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.941939 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.942287 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.942601 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.942973 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.943300 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.943614 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.943926 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.944230 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:55:18.944473 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 00:55:18.964393 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO dbcounter [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Registered counter for database nova_api Sep 18 00:55:18.982994 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_db.sqlalchemy.engines [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:55:18.989950 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writer thread running {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:55:19.009066 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO dbcounter [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Registered counter for database nova_api Sep 18 00:55:19.029888 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_db.sqlalchemy.engines [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:55:19.036350 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writer thread running {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:55:19.048703 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.context [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb16c1c6-0d79-4315-9c36-c2a3e656bbb3(cell1) {{(pid=120686) load_cells /opt/stack/nova/nova/context.py:464}} Sep 18 00:55:19.052736 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:55:19.053217 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:55:19.054783 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:55:19.055550 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:55:19.056002 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:55:19.057989 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:55:19.060760 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO dbcounter [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Registered counter for database nova_cell0 Sep 18 00:55:19.064890 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO dbcounter [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Registered counter for database nova_cell1 Sep 18 00:55:19.071899 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_db.sqlalchemy.engines [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:55:19.074524 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_db.sqlalchemy.engines [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:55:19.078808 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writer thread running {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:55:19.084513 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writer thread running {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:55:19.092699 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.context [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb16c1c6-0d79-4315-9c36-c2a3e656bbb3(cell1) {{(pid=120687) load_cells /opt/stack/nova/nova/context.py:464}} Sep 18 00:55:19.096794 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:55:19.097274 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:55:19.098844 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:55:19.099588 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:55:19.100037 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:55:19.102005 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:55:19.104034 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO dbcounter [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Registered counter for database nova_cell0 Sep 18 00:55:19.108908 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO dbcounter [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Registered counter for database nova_cell1 Sep 18 00:55:19.116335 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_db.sqlalchemy.engines [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:55:19.117668 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_db.sqlalchemy.engines [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:55:19.125755 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writer thread running {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:55:19.126091 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writer thread running {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:55:19.228338 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO dbcounter [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Registered counter for database nova_cell0 Sep 18 00:55:19.235670 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_db.sqlalchemy.engines [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:55:19.240133 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writer thread running {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:55:19.273962 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO dbcounter [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Registered counter for database nova_cell0 Sep 18 00:55:19.281087 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_db.sqlalchemy.engines [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:55:19.285518 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writer thread running {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:55:19.562230 dv-cinder-master-3-smb devstack@n-api.service[120686]: WARNING keystonemiddleware.auth_token [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:55:19.569513 dv-cinder-master-3-smb devstack@n-api.service[120686]: WARNING keystonemiddleware.auth_token [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:55:19.613889 dv-cinder-master-3-smb devstack@n-api.service[120687]: WARNING keystonemiddleware.auth_token [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:55:19.621183 dv-cinder-master-3-smb devstack@n-api.service[120687]: WARNING keystonemiddleware.auth_token [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:55:19.918048 dv-cinder-master-3-smb devstack@n-api.service[120686]: WARNING keystonemiddleware.auth_token [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:55:19.924191 dv-cinder-master-3-smb devstack@n-api.service[120686]: WARNING keystonemiddleware.auth_token [None req-98875891-4bdf-4826-b689-1bd06f28af69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:55:19.929457 dv-cinder-master-3-smb devstack@n-api.service[120686]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fdb16bd9c0 pid: 120686 (default app) Sep 18 00:55:19.973094 dv-cinder-master-3-smb devstack@n-api.service[120687]: WARNING keystonemiddleware.auth_token [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 00:55:19.979599 dv-cinder-master-3-smb devstack@n-api.service[120687]: WARNING keystonemiddleware.auth_token [None req-6f4c4752-6a63-45dc-b458-62cb168ce687 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 00:55:19.985455 dv-cinder-master-3-smb devstack@n-api.service[120687]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fdb16bd9c0 pid: 120687 (default app) Sep 18 00:55:55.843184 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=3 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:55:55.844149 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=3 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:55:55.844942 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=3 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:55:55.845720 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=3 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:55:57.526032 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fe30304b-1d51-4af6-be27-29decac640c1 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] Action: 'create', calling method: .version_select at 0x7f5673b63430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-938228955", "metadata": {"Type": "work"}}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:55:59.679969 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-fe30304b-1d51-4af6-be27-29decac640c1 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.849153 Sep 18 00:55:59.681967 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1156 bytes} [Sun Sep 18 00:55:55 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3853 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 18 00:55:59.703185 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=3 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:55:59.703848 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=3 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:55:59.703993 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=3 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:55:59.710293 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=3 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:00.124859 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3eb56832-7277-4c94-9a4b-9d95bcd43456 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] Calling method '.version_select at 0x7f5673c19f70>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:00.898407 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3eb56832-7277-4c94-9a4b-9d95bcd43456 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8397ee71-b41b-463f-80a3-8fec54fc2e43" status: 200 len: 353 microversion: 2.1 time: 1.204839 Sep 18 00:56:00.899034 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 1/2] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 00:55:59 2022] GET /compute/v2.1/os-volumes/8397ee71-b41b-463f-80a3-8fec54fc2e43 => generated 353 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:00.919529 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0f807eed-07b3-442f-a540-bde64e7dd9c0 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] Calling method '.version_select at 0x7f5673a38310>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:00.999851 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0f807eed-07b3-442f-a540-bde64e7dd9c0 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8397ee71-b41b-463f-80a3-8fec54fc2e43" status: 200 len: 353 microversion: 2.1 time: 0.086250 Sep 18 00:56:01.009829 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 00:56:00 2022] GET /compute/v2.1/os-volumes/8397ee71-b41b-463f-80a3-8fec54fc2e43 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:01.015672 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-bddf801e-6671-4dd6-b66e-502c72bca3e2 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] Calling method '.version_select at 0x7f5673a25310>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:01.167547 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-bddf801e-6671-4dd6-b66e-502c72bca3e2 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/8397ee71-b41b-463f-80a3-8fec54fc2e43" status: 202 len: 0 microversion: 2.1 time: 0.155336 Sep 18 00:56:01.168695 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 18 00:56:01 2022] DELETE /compute/v2.1/os-volumes/8397ee71-b41b-463f-80a3-8fec54fc2e43 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 00:56:01.178223 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-14ccf165-7d38-4e0a-ba7c-e297227f1a36 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] Calling method '.version_select at 0x7f5673a389d0>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:01.284313 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-14ccf165-7d38-4e0a-ba7c-e297227f1a36 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8397ee71-b41b-463f-80a3-8fec54fc2e43" status: 200 len: 352 microversion: 2.1 time: 0.111072 Sep 18 00:56:01.292127 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 3/5] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 00:56:01 2022] GET /compute/v2.1/os-volumes/8397ee71-b41b-463f-80a3-8fec54fc2e43 => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:02.299876 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-69394be0-6755-4063-84ce-2b2d00cd6bb3 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] Calling method '.version_select at 0x7f5673a259d0>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:02.358982 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-69394be0-6755-4063-84ce-2b2d00cd6bb3 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] HTTP exception thrown: Volume 8397ee71-b41b-463f-80a3-8fec54fc2e43 could not be found. Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-69394be0-6755-4063-84ce-2b2d00cd6bb3 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] Request method failure captured: Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/os-volumes/8397ee71-b41b-463f-80a3-8fec54fc2e43 HTTP/1.1 Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmybEWZHNZDrpp2gKOrBokafma4fIxxIwioDzVMSZv_0oMrl2qk9xSo3zoV09mw8SBvu_74DEAtpP1dPTw-dHPEd2ZoTX0qy4qZeyBe5RUljK9NFFppUCnR0H12diD_ww6ga5nm0fPyQGiGGox7l9U0M9rWB7kkbz6iBkKI94RVo-tI Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: c20eb74e62d84e548e368b9d72440e24 Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-VolumesGetTestJSON-1734320216 Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 00:56:02.363554 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c20eb74e62d84e548e368b9d72440e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c20eb74e62d84e548e368b9d72440e24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c20eb74e62d84e548e368b9d72440e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c20eb74e62d84e548e368b9d72440e24"}]}] Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-VolumesGetTestJSON-1734320216 Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: c20eb74e62d84e548e368b9d72440e24 Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-VolumesGetTestJSON-1734320216 Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-VolumesGetTestJSON-1734320216-project Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: bf06ad910f574b8d82a8eb4f68ec0c16 Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-VolumesGetTestJSON-1734320216-project Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Volume 8397ee71-b41b-463f-80a3-8fec54fc2e43 could not be found. Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '8397ee71-b41b-463f-80a3-8fec54fc2e43'} Sep 18 00:56:02.364753 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8397ee71-b41b-463f-80a3-8fec54fc2e43 could not be found. (HTTP 404) (Request-ID: req-8df608ba-6692-4a4b-925f-282ca4ada9ff) Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:02.365468 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 00:56:02.366490 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8397ee71-b41b-463f-80a3-8fec54fc2e43 could not be found. Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 18 00:56:02.367503 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8397ee71-b41b-463f-80a3-8fec54fc2e43 could not be found. Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8397ee71-b41b-463f-80a3-8fec54fc2e43 could not be found. Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:02.369081 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-69394be0-6755-4063-84ce-2b2d00cd6bb3 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] Returning 404 to user: Volume 8397ee71-b41b-463f-80a3-8fec54fc2e43 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:56:02.371102 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-69394be0-6755-4063-84ce-2b2d00cd6bb3 tempest-VolumesGetTestJSON-1734320216 tempest-VolumesGetTestJSON-1734320216-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8397ee71-b41b-463f-80a3-8fec54fc2e43" status: 404 len: 109 microversion: 2.1 time: 0.075546 Sep 18 00:56:02.372097 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 3/6] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 00:56:02 2022] GET /compute/v2.1/os-volumes/8397ee71-b41b-463f-80a3-8fec54fc2e43 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 00:56:07.261851 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e3f3191f-30c2-43b7-88cc-0b79dc117b2d tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Action: 'create', calling method: .version_select at 0x7f56739d1040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-206245001", "metadata": {"Type": "work"}}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e3f3191f-30c2-43b7-88cc-0b79dc117b2d tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Request method failure captured: Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 121 Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmymA_i0z0iXDhuLTEz52Xx7hyc9LJMi1oL5MVNNJVzeoI_mB1RUAy-p80w3DIDWbq5L2KeOopPvz8A9Fg4WwWNDVSLU2DIfYUo_VwIXh3SGenWVEuLxnBGrZ92QxZOj5UcRAdAV8EqShKFVzqtwVTBIlbTWI0sO8mNeHHnl2yVcg4U Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:56:07.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92a28717f63247dba23a73e22738765c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92a28717f63247dba23a73e22738765c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}] Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: fad19abca8314b3f80e885e610601825 Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-206245001", "metadata": {"Type": "work"}}} Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: Sep 18 00:56:07.283512 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-206245001', 'metadata': {'Type': 'work'}}}} Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise error Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi '#$%' Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:56:07.284311 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 00:56:07.285635 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 00:56:07.286755 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 18 00:56:07.286755 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.290572 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e3f3191f-30c2-43b7-88cc-0b79dc117b2d tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:56:07.293711 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e3f3191f-30c2-43b7-88cc-0b79dc117b2d tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.519296 Sep 18 00:56:07.298452 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 4/7] 10.222.0.33 () {60 vars in 1156 bytes} [Sun Sep 18 00:56:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 523 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 00:56:07.306144 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-fa41e3cb-7323-42fd-beea-8e084686e58f tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Action: 'create', calling method: .version_select at 0x7f56739ff9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1683501654", "metadata": {"Type": "work"}}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-fa41e3cb-7323-42fd-beea-8e084686e58f tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Request method failure captured: Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 120 Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmymA_i0z0iXDhuLTEz52Xx7hyc9LJMi1oL5MVNNJVzeoI_mB1RUAy-p80w3DIDWbq5L2KeOopPvz8A9Fg4WwWNDVSLU2DIfYUo_VwIXh3SGenWVEuLxnBGrZ92QxZOj5UcRAdAV8EqShKFVzqtwVTBIlbTWI0sO8mNeHHnl2yVcg4U Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 00:56:07.327150 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92a28717f63247dba23a73e22738765c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92a28717f63247dba23a73e22738765c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}] Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: fad19abca8314b3f80e885e610601825 Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1683501654", "metadata": {"Type": "work"}}} Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: Sep 18 00:56:07.328494 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1683501654', 'metadata': {'Type': 'work'}}}} Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise error Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi '0' Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:56:07.329283 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 00:56:07.334461 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 00:56:07.335511 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 18 00:56:07.335511 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.335511 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-fa41e3cb-7323-42fd-beea-8e084686e58f tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:56:07.335511 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-fa41e3cb-7323-42fd-beea-8e084686e58f tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029186 Sep 18 00:56:07.335511 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 4/8] 10.222.0.33 () {60 vars in 1156 bytes} [Sun Sep 18 00:56:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 00:56:07.338712 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-80d7ecc0-1abd-4151-979b-50dbbf7f98fa tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Action: 'create', calling method: .version_select at 0x7f5673a383a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1703787896", "metadata": {"Type": "work"}}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-80d7ecc0-1abd-4151-979b-50dbbf7f98fa tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Request method failure captured: Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 119 Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmymA_i0z0iXDhuLTEz52Xx7hyc9LJMi1oL5MVNNJVzeoI_mB1RUAy-p80w3DIDWbq5L2KeOopPvz8A9Fg4WwWNDVSLU2DIfYUo_VwIXh3SGenWVEuLxnBGrZ92QxZOj5UcRAdAV8EqShKFVzqtwVTBIlbTWI0sO8mNeHHnl2yVcg4U Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:56:07.342356 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92a28717f63247dba23a73e22738765c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92a28717f63247dba23a73e22738765c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}] Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: fad19abca8314b3f80e885e610601825 Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1703787896", "metadata": {"Type": "work"}}} Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: Sep 18 00:56:07.343524 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1703787896', 'metadata': {'Type': 'work'}}}} Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise error Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi '' Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:56:07.344177 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 18 00:56:07.345234 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 18 00:56:07.346139 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 18 00:56:07.346139 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.364602 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-80d7ecc0-1abd-4151-979b-50dbbf7f98fa tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:56:07.366097 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-80d7ecc0-1abd-4151-979b-50dbbf7f98fa tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031355 Sep 18 00:56:07.371090 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 5/9] 10.222.0.33 () {60 vars in 1156 bytes} [Sun Sep 18 00:56:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 00:56:07.382442 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e17d65d0-eae0-4212-b832-df8b4becb8b6 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Calling method '.version_select at 0x7f567398de50>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:07.459030 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-e17d65d0-eae0-4212-b832-df8b4becb8b6 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] HTTP exception thrown: Volume tempest-invalid-564607730 could not be found. Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e17d65d0-eae0-4212-b832-df8b4becb8b6 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Request method failure captured: Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-564607730 HTTP/1.1 Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmymA_i0z0iXDhuLTEz52Xx7hyc9LJMi1oL5MVNNJVzeoI_mB1RUAy-p80w3DIDWbq5L2KeOopPvz8A9Fg4WwWNDVSLU2DIfYUo_VwIXh3SGenWVEuLxnBGrZ92QxZOj5UcRAdAV8EqShKFVzqtwVTBIlbTWI0sO8mNeHHnl2yVcg4U Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:56:07.466637 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92a28717f63247dba23a73e22738765c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92a28717f63247dba23a73e22738765c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}] Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: fad19abca8314b3f80e885e610601825 Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Volume tempest-invalid-564607730 could not be found. Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'tempest-invalid-564607730'} Sep 18 00:56:07.467935 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-564607730 could not be found. (HTTP 404) (Request-ID: req-8d11db7f-09ee-4432-9a64-2d6a5f52d6bf) Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.468676 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 00:56:07.473633 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-564607730 could not be found. Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:56:07.474775 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-564607730 could not be found. Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-564607730 could not be found. Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e17d65d0-eae0-4212-b832-df8b4becb8b6 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Returning 404 to user: Volume tempest-invalid-564607730 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e17d65d0-eae0-4212-b832-df8b4becb8b6 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-564607730" status: 404 len: 98 microversion: 2.1 time: 0.095879 Sep 18 00:56:07.475876 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 6/10] 10.222.0.33 () {58 vars in 1215 bytes} [Sun Sep 18 00:56:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-564607730 => generated 98 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 18 00:56:07.479383 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b99f6c96-cd78-4fb7-a7c5-05bf8254d27c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Action: 'create', calling method: .version_select at 0x7f56739969d0>, body: {"keypair": {"name": "tempest-keypair-917426502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYj/3s5PedcTR/5+hXrZ0Ddcj93ZsspZFO7BRbaMnT2SyadHTEuuaei9rcGxXLcRueDmgPvzVcVKs5NrSiyGtUyvrQmCUBI6DkX3voKW9igPXkaYEslHPxz1NQpkSYt8Q=="}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:07.491732 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-467d0dd9-cd13-4321-b551-bdf0c2259d40 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006028 Sep 18 00:56:07.492285 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 7/11] 10.222.0.33 () {58 vars in 1140 bytes} [Sun Sep 18 00:56:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 18 00:56:07.529366 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c9d442b9-58ca-409b-8a5b-a0740d8236a7 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022761 Sep 18 00:56:07.529904 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 8/12] 10.222.0.33 () {58 vars in 1137 bytes} [Sun Sep 18 00:56:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 18 00:56:07.543909 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c2fd1f62-c5bd-4a91-ad65-e9d1eba0de27 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Calling method '.version_select at 0x7f56739d1af0>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:07.648838 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-c2fd1f62-c5bd-4a91-ad65-e9d1eba0de27 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] HTTP exception thrown: Volume 5ee77a78-23ca-4554-9265-fbe4e1a4049b could not be found. Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c2fd1f62-c5bd-4a91-ad65-e9d1eba0de27 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Request method failure captured: Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: DELETE /compute/v2.1/os-volumes/5ee77a78-23ca-4554-9265-fbe4e1a4049b HTTP/1.1 Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmymA_i0z0iXDhuLTEz52Xx7hyc9LJMi1oL5MVNNJVzeoI_mB1RUAy-p80w3DIDWbq5L2KeOopPvz8A9Fg4WwWNDVSLU2DIfYUo_VwIXh3SGenWVEuLxnBGrZ92QxZOj5UcRAdAV8EqShKFVzqtwVTBIlbTWI0sO8mNeHHnl2yVcg4U Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:56:07.650914 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92a28717f63247dba23a73e22738765c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92a28717f63247dba23a73e22738765c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}] Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: fad19abca8314b3f80e885e610601825 Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Volume 5ee77a78-23ca-4554-9265-fbe4e1a4049b could not be found. Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '5ee77a78-23ca-4554-9265-fbe4e1a4049b'} Sep 18 00:56:07.652195 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ee77a78-23ca-4554-9265-fbe4e1a4049b could not be found. (HTTP 404) (Request-ID: req-da621ca3-e57f-435d-a822-1d39b6fd15fc) Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.652912 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 00:56:07.654039 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ee77a78-23ca-4554-9265-fbe4e1a4049b could not be found. Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 18 00:56:07.655087 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:56:07.656162 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ee77a78-23ca-4554-9265-fbe4e1a4049b could not be found. Sep 18 00:56:07.656162 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.656162 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.656162 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.656162 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.656162 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.656162 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.656162 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:56:07.656162 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:56:07.656162 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ee77a78-23ca-4554-9265-fbe4e1a4049b could not be found. Sep 18 00:56:07.656162 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.657683 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c2fd1f62-c5bd-4a91-ad65-e9d1eba0de27 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Returning 404 to user: Volume 5ee77a78-23ca-4554-9265-fbe4e1a4049b could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:56:07.659658 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c2fd1f62-c5bd-4a91-ad65-e9d1eba0de27 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/5ee77a78-23ca-4554-9265-fbe4e1a4049b" status: 404 len: 109 microversion: 2.1 time: 0.124143 Sep 18 00:56:07.660463 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 9/13] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 18 00:56:07 2022] DELETE /compute/v2.1/os-volumes/5ee77a78-23ca-4554-9265-fbe4e1a4049b => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 00:56:07.670421 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3fe52805-4b59-4294-828d-a0205083fe00 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Calling method '.version_select at 0x7f56739d18b0>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:07.687704 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-b99f6c96-cd78-4fb7-a7c5-05bf8254d27c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Getting quotas for project a60d2801df884e15be8a0464cb725d6d. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:56:07.708443 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-b99f6c96-cd78-4fb7-a7c5-05bf8254d27c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Getting quotas for user 5e49a94877574c58aa4ff068b69a3dd6 and project a60d2801df884e15be8a0464cb725d6d. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:56:07.719400 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-3fe52805-4b59-4294-828d-a0205083fe00 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] HTTP exception thrown: Volume f1353ca0-875a-497d-8456-e02d9d511ccb could not be found. Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3fe52805-4b59-4294-828d-a0205083fe00 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Request method failure captured: Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/os-volumes/f1353ca0-875a-497d-8456-e02d9d511ccb HTTP/1.1 Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmymA_i0z0iXDhuLTEz52Xx7hyc9LJMi1oL5MVNNJVzeoI_mB1RUAy-p80w3DIDWbq5L2KeOopPvz8A9Fg4WwWNDVSLU2DIfYUo_VwIXh3SGenWVEuLxnBGrZ92QxZOj5UcRAdAV8EqShKFVzqtwVTBIlbTWI0sO8mNeHHnl2yVcg4U Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:56:07.722386 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92a28717f63247dba23a73e22738765c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92a28717f63247dba23a73e22738765c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92a28717f63247dba23a73e22738765c"}]}] Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 92a28717f63247dba23a73e22738765c Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-VolumesNegativeTest-2082273912 Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: fad19abca8314b3f80e885e610601825 Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-VolumesNegativeTest-2082273912-project Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Volume f1353ca0-875a-497d-8456-e02d9d511ccb could not be found. Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'f1353ca0-875a-497d-8456-e02d9d511ccb'} Sep 18 00:56:07.723686 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1353ca0-875a-497d-8456-e02d9d511ccb could not be found. (HTTP 404) (Request-ID: req-fcf52667-d74a-4d1a-9272-ccab2f3a4c32) Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.724514 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 00:56:07.725594 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1353ca0-875a-497d-8456-e02d9d511ccb could not be found. Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 18 00:56:07.726643 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:56:07.728579 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1353ca0-875a-497d-8456-e02d9d511ccb could not be found. Sep 18 00:56:07.728579 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.728579 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:56:07.728579 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.728579 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:56:07.728579 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:56:07.728579 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:56:07.728579 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:56:07.728579 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:56:07.728579 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1353ca0-875a-497d-8456-e02d9d511ccb could not be found. Sep 18 00:56:07.728579 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:56:07.730430 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3fe52805-4b59-4294-828d-a0205083fe00 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] Returning 404 to user: Volume f1353ca0-875a-497d-8456-e02d9d511ccb could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:56:07.731969 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3fe52805-4b59-4294-828d-a0205083fe00 tempest-VolumesNegativeTest-2082273912 tempest-VolumesNegativeTest-2082273912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f1353ca0-875a-497d-8456-e02d9d511ccb" status: 404 len: 109 microversion: 2.1 time: 0.065078 Sep 18 00:56:07.741733 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 10/14] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 00:56:07 2022] GET /compute/v2.1/os-volumes/f1353ca0-875a-497d-8456-e02d9d511ccb => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 00:56:07.840030 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b99f6c96-cd78-4fb7-a7c5-05bf8254d27c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.492045 Sep 18 00:56:07.840744 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 5/15] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 18 00:56:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:14.395113 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-236666387", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e60962c-164c-4e15-8d69-6601f5d7b205"}], "security_groups": [{"name": "tempest-securitygroup--1991616283"}], "key_name": "tempest-keypair-917426502", "user_data": "}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:14.807143 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.network.neutron [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] validate_networks() for [('3e60962c-164c-4e15-8d69-6601f5d7b205', None, None, None, None, None)] {{(pid=120686) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:56:15.569721 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1fa84f1f-30b8-4f6b-9f5d-367621f152ee tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Action: 'create', calling method: .version_select at 0x7f567392a280>, body: {"keypair": {"name": "tempest-keypair-1706853748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkcSQ8G5nqyFY3dKJReikiyUKnqrAQrxfFka88TK20o15B3QnVHOyWa2WCHt4v6RrT5affJGtUD6FU+m7+6tfP4noWWmRPHPk+2uPl9c9ZHFzZsnj8DIIWPmd4ugA8GLA=="}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:15.629015 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-1fa84f1f-30b8-4f6b-9f5d-367621f152ee tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Getting quotas for project 1a7f6c917c934c00a862b9946ce2b1cd. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:56:15.638318 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-1fa84f1f-30b8-4f6b-9f5d-367621f152ee tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Getting quotas for user 1044cd9cbbe1497aae1939fe81f3f9a5 and project 1a7f6c917c934c00a862b9946ce2b1cd. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:56:15.725335 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1fa84f1f-30b8-4f6b-9f5d-367621f152ee tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.251715 Sep 18 00:56:15.726967 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 6/16] 10.222.0.33 () {62 vars in 1200 bytes} [Sun Sep 18 00:56:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1254 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 18 00:56:17.400201 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Flavor limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:56:17.400718 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Image limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:56:17.401102 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Flavor pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:56:17.401521 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Image pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:56:17.401949 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:56:17.452879 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:17.453376 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:17.453829 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:17.456442 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:17.456976 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:17.457441 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:17.576240 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Getting quotas for project a60d2801df884e15be8a0464cb725d6d. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:56:17.611492 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Getting quotas for user 5e49a94877574c58aa4ff068b69a3dd6 and project a60d2801df884e15be8a0464cb725d6d. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:56:17.657311 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Going to run 1 instances... {{(pid=120686) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:56:17.671563 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:56:17.943541 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-08743b0b-4dfe-47bc-8ba6-a54bac56eedb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.552612 Sep 18 00:56:17.946837 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 11/17] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:56:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 3558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:56:17.958663 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-42ce5db4-8929-46ef-abb0-46c921b5fcc9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:17.960178 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-42ce5db4-8929-46ef-abb0-46c921b5fcc9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:18.272567 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-42ce5db4-8929-46ef-abb0-46c921b5fcc9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:18.297617 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-42ce5db4-8929-46ef-abb0-46c921b5fcc9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1236 microversion: 2.1 time: 0.344882 Sep 18 00:56:18.302540 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 7/18] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:17 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1236 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:19.329963 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-76420a87-8438-498e-943c-1483ed966f4c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:19.330644 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-76420a87-8438-498e-943c-1483ed966f4c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:19.604637 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-76420a87-8438-498e-943c-1483ed966f4c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:19.642055 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-76420a87-8438-498e-943c-1483ed966f4c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1236 microversion: 2.1 time: 0.319957 Sep 18 00:56:19.648718 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 12/19] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:19 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1236 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:20.391878 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-322657286", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b2870f5-1df6-4588-9304-3be88fc2aeec"}], "security_groups": [{"name": "tempest-securitygroup--726730653"}], "key_name": "tempest-keypair-1706853748", "user_data": "}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:20.670341 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e686552c-0102-47fd-81ab-57eaa3208f14 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:20.672084 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e686552c-0102-47fd-81ab-57eaa3208f14 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:20.739755 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] validate_networks() for [('5b2870f5-1df6-4588-9304-3be88fc2aeec', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:56:20.812980 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e686552c-0102-47fd-81ab-57eaa3208f14 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:20.825012 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e686552c-0102-47fd-81ab-57eaa3208f14 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1236 microversion: 2.1 time: 0.159158 Sep 18 00:56:20.827331 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 13/20] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:20 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1236 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:21.244608 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7da4517c-bd76-4bbe-8ba4-71ba850d958e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: .version_select at 0x7f5673013ee0>, body: {"keypair": {"name": "tempest-keypair-25974457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8EbUy37Fb0ezJJc1kXrfenX85nx3edDpwNJyKip4WjpgF9y+FkC0qLaXB9RFzq9I5MeLDCJFGrwQ3HIdFX/DH87Nr8dJJPaHCY/Unn6Cof9L14iYbcZWOAWs5yATDhsQ=="}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:21.300036 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-7da4517c-bd76-4bbe-8ba4-71ba850d958e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'key_pairs'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:56:21.332053 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-7da4517c-bd76-4bbe-8ba4-71ba850d958e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for user f19ac9f3986640ae9b7993b98dd403c0 and project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'key_pairs'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:56:21.473618 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7da4517c-bd76-4bbe-8ba4-71ba850d958e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.469799 Sep 18 00:56:21.477770 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 14/21] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 18 00:56:20 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:21.853818 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-40858e86-58df-4af0-97a4-e7981f84de2b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:21.855760 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-40858e86-58df-4af0-97a4-e7981f84de2b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:21.874113 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-40858e86-58df-4af0-97a4-e7981f84de2b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:21.877423 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-40858e86-58df-4af0-97a4-e7981f84de2b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:21.881443 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-40858e86-58df-4af0-97a4-e7981f84de2b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:21.883853 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-40858e86-58df-4af0-97a4-e7981f84de2b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:21.885191 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-40858e86-58df-4af0-97a4-e7981f84de2b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:21.886434 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-40858e86-58df-4af0-97a4-e7981f84de2b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:22.658419 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-40858e86-58df-4af0-97a4-e7981f84de2b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:22.680590 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-40858e86-58df-4af0-97a4-e7981f84de2b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1288 microversion: 2.1 time: 0.833195 Sep 18 00:56:22.682221 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 15/22] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:21 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1288 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:22.874814 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-535983514", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "networks": [{"uuid": "e0ba4f30-bf7e-461f-88f4-1cd7adb83e44"}]}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:23.018601 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.network.neutron [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] validate_networks() for [('e0ba4f30-bf7e-461f-88f4-1cd7adb83e44', None, None, None, None, None)] {{(pid=120686) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:56:23.852127 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:56:23.853240 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:56:23.853874 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:56:23.854424 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:56:23.855047 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:56:23.894012 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:23.895382 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:23.897056 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:23.899594 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:23.900551 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:23.902863 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:24.018642 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Getting quotas for project 1a7f6c917c934c00a862b9946ce2b1cd. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:56:24.031628 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Getting quotas for user 1044cd9cbbe1497aae1939fe81f3f9a5 and project 1a7f6c917c934c00a862b9946ce2b1cd. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:56:24.058428 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:56:24.072269 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:56:24.273738 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-cc159f92-1f3c-47b4-a689-b5b014007a49 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.896084 Sep 18 00:56:24.283332 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 8/23] 10.222.0.33 () {62 vars in 1188 bytes} [Sun Sep 18 00:56:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 3908 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 00:56:24.516806 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1475356510", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:24.682674 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] validate_networks() for [('c62b9e47-59b6-47ba-845f-e3be4dd39ad8', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:56:24.845294 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Flavor limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:56:24.845842 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Image limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:56:24.846354 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Flavor pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:56:24.846842 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Image pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:56:24.847419 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:56:24.888613 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:24.889514 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:24.890181 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:24.892509 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:24.896785 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:24.897379 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:25.005498 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Getting quotas for project d8e0132d9e0c47b9b4c2042dba767701. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:56:25.041860 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Getting quotas for user 2a703706c16c4ff3a07c37ba65d26778 and project d8e0132d9e0c47b9b4c2042dba767701. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:56:25.103075 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Going to run 1 instances... {{(pid=120686) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:56:25.115718 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:56:25.344543 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-4397b6ad-8e68-427c-85ed-023afcedcd6e tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.660663 Sep 18 00:56:25.345293 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 16/24] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:56:25.369412 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-80f5caf0-3719-45bf-8592-88c49a0918ab tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:25.370049 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-80f5caf0-3719-45bf-8592-88c49a0918ab tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:25.406137 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80f5caf0-3719-45bf-8592-88c49a0918ab tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:25.409247 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80f5caf0-3719-45bf-8592-88c49a0918ab tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:25.409751 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80f5caf0-3719-45bf-8592-88c49a0918ab tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:25.413065 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80f5caf0-3719-45bf-8592-88c49a0918ab tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:25.413675 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80f5caf0-3719-45bf-8592-88c49a0918ab tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:25.420141 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80f5caf0-3719-45bf-8592-88c49a0918ab tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:27.300035 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-80f5caf0-3719-45bf-8592-88c49a0918ab tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:27.312618 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-80f5caf0-3719-45bf-8592-88c49a0918ab tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1362 microversion: 2.1 time: 1.962473 Sep 18 00:56:27.313904 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 17/25] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:25 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1362 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:27.320645 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:27.321741 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:27.329921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:27.332731 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:27.335202 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:27.337295 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:27.338506 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:27.339316 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:28.016354 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:28.027653 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:28.042550 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:28.043784 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-6d7e8824-7d28-4c4c-8d81-f7389618ce52 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1285 microversion: 2.20 time: 0.728576 Sep 18 00:56:28.045804 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 18/26] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:27 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1285 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:28.064858 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c222aaef-15f1-4779-96a1-f4a393c18ab5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:28.065450 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c222aaef-15f1-4779-96a1-f4a393c18ab5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:28.080873 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c222aaef-15f1-4779-96a1-f4a393c18ab5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:28.081649 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c222aaef-15f1-4779-96a1-f4a393c18ab5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:28.082247 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c222aaef-15f1-4779-96a1-f4a393c18ab5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:28.083718 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c222aaef-15f1-4779-96a1-f4a393c18ab5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:28.087553 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c222aaef-15f1-4779-96a1-f4a393c18ab5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:28.088452 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c222aaef-15f1-4779-96a1-f4a393c18ab5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:28.173587 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:56:28.174054 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:56:28.174484 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:56:28.174964 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:56:28.175387 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:56:28.197402 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:28.197902 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:28.198358 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:28.199121 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:28.199583 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:28.200011 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:28.327872 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Getting quotas for project 8cbf74b218c04911bb921f7cc2c6e966. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:56:28.340778 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Getting quotas for user 4d84f31e15924d3c8dbd7aac8a0f3576 and project 8cbf74b218c04911bb921f7cc2c6e966. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:56:28.345572 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c222aaef-15f1-4779-96a1-f4a393c18ab5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:28.360026 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c222aaef-15f1-4779-96a1-f4a393c18ab5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1266 microversion: 2.1 time: 0.312451 Sep 18 00:56:28.360621 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 19/27] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:28 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:28.386572 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-069bf57a-584c-4819-98e5-975121e49817 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:28.387441 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-069bf57a-584c-4819-98e5-975121e49817 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:28.388825 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:56:28.391453 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:56:28.396757 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-069bf57a-584c-4819-98e5-975121e49817 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:28.397347 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-069bf57a-584c-4819-98e5-975121e49817 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:28.397918 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-069bf57a-584c-4819-98e5-975121e49817 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:28.398630 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-069bf57a-584c-4819-98e5-975121e49817 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:28.399115 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-069bf57a-584c-4819-98e5-975121e49817 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:28.399550 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-069bf57a-584c-4819-98e5-975121e49817 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:28.510963 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f911fd07-d47d-4b1c-b387-2ec5c51379f9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.225925 Sep 18 00:56:28.518070 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 9/28] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:56:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 4232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:56:28.532655 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-77159527-585c-485e-a53e-1b1c29166c49 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:28.540201 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-77159527-585c-485e-a53e-1b1c29166c49 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:29.150095 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-77159527-585c-485e-a53e-1b1c29166c49 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:29.166875 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-77159527-585c-485e-a53e-1b1c29166c49 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1222 microversion: 2.1 time: 0.638857 Sep 18 00:56:29.171130 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 10/29] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:28 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1222 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:29.185297 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:29.188454 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:29.217823 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:29.221168 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:29.235003 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:29.238837 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:29.245168 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:29.246049 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:29.735918 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-069bf57a-584c-4819-98e5-975121e49817 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:29.772073 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-069bf57a-584c-4819-98e5-975121e49817 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1362 microversion: 2.1 time: 1.388689 Sep 18 00:56:29.790648 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 20/30] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:28 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1362 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:29.806633 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-945fbdbb-6928-4438-b8b0-ab9c5fac1af6 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:29.809093 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-945fbdbb-6928-4438-b8b0-ab9c5fac1af6 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:29.841843 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-945fbdbb-6928-4438-b8b0-ab9c5fac1af6 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:29.844311 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-945fbdbb-6928-4438-b8b0-ab9c5fac1af6 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:29.845489 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-945fbdbb-6928-4438-b8b0-ab9c5fac1af6 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:29.847319 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-945fbdbb-6928-4438-b8b0-ab9c5fac1af6 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:29.849050 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-945fbdbb-6928-4438-b8b0-ab9c5fac1af6 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:29.851196 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-945fbdbb-6928-4438-b8b0-ab9c5fac1af6 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:29.870630 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:29.923691 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:29.930072 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:29.934761 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5427bf13-9cb1-42bf-8984-ad67cd763418 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1333 microversion: 2.20 time: 0.761699 Sep 18 00:56:29.936896 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 11/31] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:29 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1333 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:29.952106 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1706036433", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:30.113154 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] validate_networks() for [('c62b9e47-59b6-47ba-845f-e3be4dd39ad8', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:56:30.192381 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-945fbdbb-6928-4438-b8b0-ab9c5fac1af6 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:30.213045 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-945fbdbb-6928-4438-b8b0-ab9c5fac1af6 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1272 microversion: 2.1 time: 0.416764 Sep 18 00:56:30.218965 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 21/32] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:29 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1272 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:30.250309 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1473937176", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eee7c814-dc91-4de0-b55e-0732fcd7c9de"}], "security_groups": [{"name": "tempest-securitygroup--303034548"}], "key_name": "tempest-keypair-25974457", "user_data": "}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:31.043846 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.network.neutron [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] validate_networks() for [('eee7c814-dc91-4de0-b55e-0732fcd7c9de', None, None, None, None, None)] {{(pid=120686) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:56:33.232246 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:56:33.232819 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:56:33.233153 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:56:33.233634 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:56:33.234058 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:56:33.259197 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=8 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:33.268896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=25 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:33.284712 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:33.285217 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:33.288252 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:33.290950 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:33.291844 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:33.294087 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:33.357280 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Getting quotas for project 8cbf74b218c04911bb921f7cc2c6e966. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:56:33.367579 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Getting quotas for user 4d84f31e15924d3c8dbd7aac8a0f3576 and project 8cbf74b218c04911bb921f7cc2c6e966. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:56:33.408813 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:56:33.411717 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:56:33.567302 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f8b911b9-c71d-4087-ada3-039cffb2eecb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.627670 Sep 18 00:56:33.570756 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 12/33] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:56:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 3633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:56:33.595579 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9b026e11-4630-4970-9e7f-d1b026ca93b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:33.596398 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9b026e11-4630-4970-9e7f-d1b026ca93b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:33.611345 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9b026e11-4630-4970-9e7f-d1b026ca93b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:33.612842 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9b026e11-4630-4970-9e7f-d1b026ca93b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:33.616227 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9b026e11-4630-4970-9e7f-d1b026ca93b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:33.618201 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9b026e11-4630-4970-9e7f-d1b026ca93b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:33.621409 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9b026e11-4630-4970-9e7f-d1b026ca93b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:33.623418 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9b026e11-4630-4970-9e7f-d1b026ca93b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:34.924317 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=4 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:35.065557 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=20 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:35.149205 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Flavor limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:56:35.149810 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Image limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:56:35.150319 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Flavor pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:56:35.150831 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Image pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:56:35.151260 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:56:35.172831 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:35.175938 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:35.177389 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:35.180209 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:35.180800 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:35.181316 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:35.213444 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9b026e11-4630-4970-9e7f-d1b026ca93b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:35.231665 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9b026e11-4630-4970-9e7f-d1b026ca93b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1362 microversion: 2.1 time: 1.647559 Sep 18 00:56:35.253482 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 13/34] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:33 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1362 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:35.273940 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:35.276720 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:35.292254 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:56:35.299671 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:35.300042 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:35.317443 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:35.320321 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:35.324204 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:35.327253 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for user f19ac9f3986640ae9b7993b98dd403c0 and project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:56:35.330156 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:35.409871 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Going to run 1 instances... {{(pid=120686) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:56:35.416173 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:56:35.578272 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-6ef37b4f-62ba-41f1-82ea-5c025af37089 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.334242 Sep 18 00:56:35.587545 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 22/35] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:56:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 5344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 00:56:35.603249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-00675842-3a19-4328-afa8-9aa1f3288337 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:35.613411 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-00675842-3a19-4328-afa8-9aa1f3288337 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:35.635084 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00675842-3a19-4328-afa8-9aa1f3288337 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:35.640096 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00675842-3a19-4328-afa8-9aa1f3288337 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:35.643942 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00675842-3a19-4328-afa8-9aa1f3288337 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:35.648312 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00675842-3a19-4328-afa8-9aa1f3288337 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:35.652177 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00675842-3a19-4328-afa8-9aa1f3288337 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:35.654537 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00675842-3a19-4328-afa8-9aa1f3288337 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:36.776354 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:36.786155 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:36.805338 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:36.806631 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7f400f06-e3c9-43b8-84b7-395d1e63a785 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 1.552042 Sep 18 00:56:36.819325 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 14/36] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:35 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:37.085330 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-00675842-3a19-4328-afa8-9aa1f3288337 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:37.105438 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-00675842-3a19-4328-afa8-9aa1f3288337 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1314 microversion: 2.1 time: 1.511046 Sep 18 00:56:37.108797 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 23/37] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:35 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1314 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:37.141695 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-864895ac-d69c-4850-ad53-845814684d0a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:37.144261 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-864895ac-d69c-4850-ad53-845814684d0a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:37.169278 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:37.173698 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-864895ac-d69c-4850-ad53-845814684d0a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:37.181826 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-864895ac-d69c-4850-ad53-845814684d0a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:37.187591 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-864895ac-d69c-4850-ad53-845814684d0a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:37.189618 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-864895ac-d69c-4850-ad53-845814684d0a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:37.193522 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-864895ac-d69c-4850-ad53-845814684d0a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:37.195175 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-864895ac-d69c-4850-ad53-845814684d0a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:37.552078 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-1ba463c5-a600-4899-a5a1-93a7a9379db2 req-7fc313cb-413d-448e-ad04-3fceb45b8606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf6631e-213a-40ea-8708-5dc51da0ee8c", "tag": "caeb66db-fb12-4f3e-b68c-119f4575bc44"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:37.631484 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-1ba463c5-a600-4899-a5a1-93a7a9379db2 req-7fc313cb-413d-448e-ad04-3fceb45b8606 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:37.632534 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-1ba463c5-a600-4899-a5a1-93a7a9379db2 req-7fc313cb-413d-448e-ad04-3fceb45b8606 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:37.633350 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-1ba463c5-a600-4899-a5a1-93a7a9379db2 req-7fc313cb-413d-448e-ad04-3fceb45b8606 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:37.701757 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-1ba463c5-a600-4899-a5a1-93a7a9379db2 req-7fc313cb-413d-448e-ad04-3fceb45b8606 service nova] Creating event network-changed:caeb66db-fb12-4f3e-b68c-119f4575bc44 for instance abf6631e-213a-40ea-8708-5dc51da0ee8c on hv-cinder-maste Sep 18 00:56:37.704121 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-1ba463c5-a600-4899-a5a1-93a7a9379db2 req-7fc313cb-413d-448e-ad04-3fceb45b8606 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120687) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 00:56:37.706281 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-1ba463c5-a600-4899-a5a1-93a7a9379db2 req-7fc313cb-413d-448e-ad04-3fceb45b8606 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120687) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 00:56:37.707817 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ece1fcc2-1c85-4e25-ae83-38948b050002 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:37.711344 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ece1fcc2-1c85-4e25-ae83-38948b050002 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:37.714163 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ece1fcc2-1c85-4e25-ae83-38948b050002 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:37.715423 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ece1fcc2-1c85-4e25-ae83-38948b050002 None None] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:37.717039 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ece1fcc2-1c85-4e25-ae83-38948b050002 None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:37.717720 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ece1fcc2-1c85-4e25-ae83-38948b050002 None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:37.735758 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.compute.rpcapi [None req-ece1fcc2-1c85-4e25-ae83-38948b050002 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 18 00:56:37.737024 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ece1fcc2-1c85-4e25-ae83-38948b050002 None None] Releasing lock "compute-rpcapi-router" {{(pid=120687) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 00:56:37.766066 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-ece1fcc2-1c85-4e25-ae83-38948b050002 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.945124 Sep 18 00:56:37.770145 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 15/38] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:37.778367 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-528b9da2-78de-4aee-84f7-c63772c31b63 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:37.783180 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-528b9da2-78de-4aee-84f7-c63772c31b63 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:37.794424 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-528b9da2-78de-4aee-84f7-c63772c31b63 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:37.795731 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-528b9da2-78de-4aee-84f7-c63772c31b63 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:37.796445 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-528b9da2-78de-4aee-84f7-c63772c31b63 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:37.797575 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-528b9da2-78de-4aee-84f7-c63772c31b63 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:37.799573 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-528b9da2-78de-4aee-84f7-c63772c31b63 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:37.800314 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-528b9da2-78de-4aee-84f7-c63772c31b63 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:38.085778 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-864895ac-d69c-4850-ad53-845814684d0a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:38.098241 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-864895ac-d69c-4850-ad53-845814684d0a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1292 microversion: 2.1 time: 0.985717 Sep 18 00:56:38.118899 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 24/39] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:37 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1292 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:38.128315 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3501a0b5-e0c7-40a8-8131-0abfd68803a1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:38.129898 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3501a0b5-e0c7-40a8-8131-0abfd68803a1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:38.158903 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3501a0b5-e0c7-40a8-8131-0abfd68803a1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:38.159421 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3501a0b5-e0c7-40a8-8131-0abfd68803a1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:38.163706 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3501a0b5-e0c7-40a8-8131-0abfd68803a1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:38.168060 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3501a0b5-e0c7-40a8-8131-0abfd68803a1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:38.168614 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3501a0b5-e0c7-40a8-8131-0abfd68803a1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:38.171715 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3501a0b5-e0c7-40a8-8131-0abfd68803a1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:39.100378 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-528b9da2-78de-4aee-84f7-c63772c31b63 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:39.118948 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-528b9da2-78de-4aee-84f7-c63772c31b63 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1236 microversion: 2.1 time: 1.344667 Sep 18 00:56:39.121611 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 16/40] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:37 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1236 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:39.153356 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:39.154421 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:39.166028 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:39.166715 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:39.172020 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:39.173001 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:39.173694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:39.175420 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:39.922515 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3501a0b5-e0c7-40a8-8131-0abfd68803a1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:39.935779 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3501a0b5-e0c7-40a8-8131-0abfd68803a1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1362 microversion: 2.1 time: 1.824183 Sep 18 00:56:39.936429 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 25/41] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:38 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1362 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:39.955595 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2b609be7-d188-475f-af33-f7e4fb935113 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:39.959521 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-2b609be7-d188-475f-af33-f7e4fb935113 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:39.993607 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b609be7-d188-475f-af33-f7e4fb935113 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:39.994446 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b609be7-d188-475f-af33-f7e4fb935113 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:39.995077 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b609be7-d188-475f-af33-f7e4fb935113 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:39.996216 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b609be7-d188-475f-af33-f7e4fb935113 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:39.996821 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b609be7-d188-475f-af33-f7e4fb935113 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:39.997394 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b609be7-d188-475f-af33-f7e4fb935113 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:40.085845 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:40.097165 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:40.111459 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:40.112666 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4c4a9253-b058-4c49-ba32-3b8c9db32774 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.989904 Sep 18 00:56:40.113253 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 17/42] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:39 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:40.148683 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-367db0d4-11bf-43e6-bb05-e386130fe945 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:40.149609 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-367db0d4-11bf-43e6-bb05-e386130fe945 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:40.168361 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-367db0d4-11bf-43e6-bb05-e386130fe945 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:40.173161 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-367db0d4-11bf-43e6-bb05-e386130fe945 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:40.173868 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-367db0d4-11bf-43e6-bb05-e386130fe945 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:40.175006 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-367db0d4-11bf-43e6-bb05-e386130fe945 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:40.176237 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-367db0d4-11bf-43e6-bb05-e386130fe945 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:40.178604 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-367db0d4-11bf-43e6-bb05-e386130fe945 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:40.491941 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-367db0d4-11bf-43e6-bb05-e386130fe945 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:40.543499 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-367db0d4-11bf-43e6-bb05-e386130fe945 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1280 microversion: 2.1 time: 0.402793 Sep 18 00:56:40.546385 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 18/43] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:40 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1280 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:40.574125 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-755e7e10-e1e7-4e2e-8186-f25c44fdbf05 req-24604a28-06f8-46e7-b137-49aa79893d4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5674ad19-62fd-4a3a-98b8-27051ad03cc7", "tag": "a8ed2c0d-d075-4325-a1f8-6418484d4934"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:40.606864 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-755e7e10-e1e7-4e2e-8186-f25c44fdbf05 req-24604a28-06f8-46e7-b137-49aa79893d4d service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:40.607484 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-755e7e10-e1e7-4e2e-8186-f25c44fdbf05 req-24604a28-06f8-46e7-b137-49aa79893d4d service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:40.608122 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-755e7e10-e1e7-4e2e-8186-f25c44fdbf05 req-24604a28-06f8-46e7-b137-49aa79893d4d service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:40.639834 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-755e7e10-e1e7-4e2e-8186-f25c44fdbf05 req-24604a28-06f8-46e7-b137-49aa79893d4d service nova] Creating event network-changed:a8ed2c0d-d075-4325-a1f8-6418484d4934 for instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 on hv-cinder-maste Sep 18 00:56:40.669585 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-755e7e10-e1e7-4e2e-8186-f25c44fdbf05 req-24604a28-06f8-46e7-b137-49aa79893d4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116944 Sep 18 00:56:40.675245 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 19/44] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:40.696654 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0e1eeaf8-c771-4f33-97f6-af25bd34a124 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:40.698924 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0e1eeaf8-c771-4f33-97f6-af25bd34a124 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:40.723431 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e1eeaf8-c771-4f33-97f6-af25bd34a124 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:40.727234 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e1eeaf8-c771-4f33-97f6-af25bd34a124 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:40.733655 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e1eeaf8-c771-4f33-97f6-af25bd34a124 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:40.734609 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e1eeaf8-c771-4f33-97f6-af25bd34a124 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:40.735302 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e1eeaf8-c771-4f33-97f6-af25bd34a124 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:40.735906 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e1eeaf8-c771-4f33-97f6-af25bd34a124 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:40.882136 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2b609be7-d188-475f-af33-f7e4fb935113 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:40.894000 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2b609be7-d188-475f-af33-f7e4fb935113 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1314 microversion: 2.1 time: 0.942048 Sep 18 00:56:40.911728 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 26/45] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:39 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1314 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:40.977725 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-5db200ac-fa19-4fb9-a31b-bafa44887c36 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:40.978335 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-5db200ac-fa19-4fb9-a31b-bafa44887c36 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:40.985579 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5db200ac-fa19-4fb9-a31b-bafa44887c36 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:40.987250 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5db200ac-fa19-4fb9-a31b-bafa44887c36 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:40.989642 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5db200ac-fa19-4fb9-a31b-bafa44887c36 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:40.991244 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5db200ac-fa19-4fb9-a31b-bafa44887c36 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:40.996317 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5db200ac-fa19-4fb9-a31b-bafa44887c36 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:40.996949 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5db200ac-fa19-4fb9-a31b-bafa44887c36 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:40.998452 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0e1eeaf8-c771-4f33-97f6-af25bd34a124 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:41.019472 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0e1eeaf8-c771-4f33-97f6-af25bd34a124 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1298 microversion: 2.1 time: 0.333665 Sep 18 00:56:41.020874 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 20/46] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:40 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1298 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:41.144816 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:41.145522 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:41.156130 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:41.158919 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:41.159647 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:41.162142 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:41.163189 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:41.164681 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:41.551839 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-5db200ac-fa19-4fb9-a31b-bafa44887c36 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:41.565338 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-5db200ac-fa19-4fb9-a31b-bafa44887c36 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1362 microversion: 2.1 time: 0.607698 Sep 18 00:56:41.581492 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 27/47] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:40 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1362 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:41.587846 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7f933c6a-53c8-4cde-83c1-ce3fadddd0bc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:41.588565 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7f933c6a-53c8-4cde-83c1-ce3fadddd0bc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:41.597464 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f933c6a-53c8-4cde-83c1-ce3fadddd0bc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:41.598017 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f933c6a-53c8-4cde-83c1-ce3fadddd0bc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:41.598538 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f933c6a-53c8-4cde-83c1-ce3fadddd0bc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:41.600011 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f933c6a-53c8-4cde-83c1-ce3fadddd0bc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:41.601023 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f933c6a-53c8-4cde-83c1-ce3fadddd0bc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:41.601805 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f933c6a-53c8-4cde-83c1-ce3fadddd0bc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:41.638824 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:41.654419 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:41.655986 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:41.657320 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-fad7b1e0-2162-4b36-b7d4-c84a9b0ea715 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.517006 Sep 18 00:56:41.657998 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 21/48] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:41 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:41.812875 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-edb671ee-5949-4cea-be24-c57f3123fba6 req-64f8b1a7-8900-42d7-863f-6c355260e8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1cf145a-d8d5-4a7e-937b-729bf79629fa", "tag": "3b10ed6a-bc95-40e6-afaa-4936e44594eb"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:41.835333 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-edb671ee-5949-4cea-be24-c57f3123fba6 req-64f8b1a7-8900-42d7-863f-6c355260e8e0 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:41.839413 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-edb671ee-5949-4cea-be24-c57f3123fba6 req-64f8b1a7-8900-42d7-863f-6c355260e8e0 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:41.839861 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-edb671ee-5949-4cea-be24-c57f3123fba6 req-64f8b1a7-8900-42d7-863f-6c355260e8e0 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:41.866377 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-edb671ee-5949-4cea-be24-c57f3123fba6 req-64f8b1a7-8900-42d7-863f-6c355260e8e0 service nova] Creating event network-changed:3b10ed6a-bc95-40e6-afaa-4936e44594eb for instance c1cf145a-d8d5-4a7e-937b-729bf79629fa on hv-cinder-maste Sep 18 00:56:41.874929 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-edb671ee-5949-4cea-be24-c57f3123fba6 req-64f8b1a7-8900-42d7-863f-6c355260e8e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160027 Sep 18 00:56:41.887152 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 22/49] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:56:41.918022 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-2bb622de-eece-47ff-be8e-ceb3c7b78ffe tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:41.918726 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-2bb622de-eece-47ff-be8e-ceb3c7b78ffe tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:41.934457 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bb622de-eece-47ff-be8e-ceb3c7b78ffe tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:41.934984 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bb622de-eece-47ff-be8e-ceb3c7b78ffe tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:41.935417 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bb622de-eece-47ff-be8e-ceb3c7b78ffe tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:41.936117 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bb622de-eece-47ff-be8e-ceb3c7b78ffe tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:41.936571 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bb622de-eece-47ff-be8e-ceb3c7b78ffe tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:41.936993 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bb622de-eece-47ff-be8e-ceb3c7b78ffe tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:41.950347 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7f933c6a-53c8-4cde-83c1-ce3fadddd0bc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:41.961243 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7f933c6a-53c8-4cde-83c1-ce3fadddd0bc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1322 microversion: 2.1 time: 0.379892 Sep 18 00:56:41.983356 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 28/50] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:41 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:42.049402 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ed16a200-806c-4fd2-a8aa-2431d4c52a87 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:42.050272 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ed16a200-806c-4fd2-a8aa-2431d4c52a87 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:42.060894 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ed16a200-806c-4fd2-a8aa-2431d4c52a87 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:42.061735 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ed16a200-806c-4fd2-a8aa-2431d4c52a87 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:42.066528 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ed16a200-806c-4fd2-a8aa-2431d4c52a87 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:42.070036 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ed16a200-806c-4fd2-a8aa-2431d4c52a87 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:42.074179 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ed16a200-806c-4fd2-a8aa-2431d4c52a87 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:42.075186 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ed16a200-806c-4fd2-a8aa-2431d4c52a87 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:42.242131 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ed16a200-806c-4fd2-a8aa-2431d4c52a87 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:42.257632 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ed16a200-806c-4fd2-a8aa-2431d4c52a87 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1298 microversion: 2.1 time: 0.211092 Sep 18 00:56:42.258329 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 29/51] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:42 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1298 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:42.392378 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-2bb622de-eece-47ff-be8e-ceb3c7b78ffe tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:42.405803 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-2bb622de-eece-47ff-be8e-ceb3c7b78ffe tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1314 microversion: 2.1 time: 0.491598 Sep 18 00:56:42.406499 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 23/52] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:41 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:42.595171 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2ce85c69-c8d5-4e4c-87bb-261b4b07ea31 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:42.596203 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-2ce85c69-c8d5-4e4c-87bb-261b4b07ea31 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:42.615598 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ce85c69-c8d5-4e4c-87bb-261b4b07ea31 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:42.615598 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ce85c69-c8d5-4e4c-87bb-261b4b07ea31 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:42.615598 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ce85c69-c8d5-4e4c-87bb-261b4b07ea31 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:42.615598 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ce85c69-c8d5-4e4c-87bb-261b4b07ea31 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:42.615960 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ce85c69-c8d5-4e4c-87bb-261b4b07ea31 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:42.615960 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ce85c69-c8d5-4e4c-87bb-261b4b07ea31 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:42.689906 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:42.690521 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:42.706912 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:42.707419 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:42.707850 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:42.709250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:42.709926 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:42.710501 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:42.981391 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2ce85c69-c8d5-4e4c-87bb-261b4b07ea31 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:42.992747 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2ce85c69-c8d5-4e4c-87bb-261b4b07ea31 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1362 microversion: 2.1 time: 0.406920 Sep 18 00:56:43.002880 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 30/53] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:42 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1362 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:43.016650 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-8b8fcd1c-1f92-49e3-a034-4dbfa1cbba4f req-22c47bca-eb7d-41ea-9aaf-999bccd3e1be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728", "tag": "1598d49e-579f-48e5-a374-9f7da048ec3a"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:43.022564 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:43.031258 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:43.032953 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:43.034273 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7069028b-fc71-4d6c-88d1-a67ee1029b8c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.352169 Sep 18 00:56:43.051059 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-8b8fcd1c-1f92-49e3-a034-4dbfa1cbba4f req-22c47bca-eb7d-41ea-9aaf-999bccd3e1be service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:43.051059 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-8b8fcd1c-1f92-49e3-a034-4dbfa1cbba4f req-22c47bca-eb7d-41ea-9aaf-999bccd3e1be service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:43.051059 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-8b8fcd1c-1f92-49e3-a034-4dbfa1cbba4f req-22c47bca-eb7d-41ea-9aaf-999bccd3e1be service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:43.051711 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 24/54] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:42 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:43.059277 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-18fc14f2-cc5b-4180-9077-5434b831f43d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:43.060131 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-18fc14f2-cc5b-4180-9077-5434b831f43d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:43.067279 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-18fc14f2-cc5b-4180-9077-5434b831f43d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:43.068076 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-18fc14f2-cc5b-4180-9077-5434b831f43d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:43.069148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-18fc14f2-cc5b-4180-9077-5434b831f43d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:43.070317 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-18fc14f2-cc5b-4180-9077-5434b831f43d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:43.071288 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-18fc14f2-cc5b-4180-9077-5434b831f43d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:43.071882 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-18fc14f2-cc5b-4180-9077-5434b831f43d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:43.094625 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-8b8fcd1c-1f92-49e3-a034-4dbfa1cbba4f req-22c47bca-eb7d-41ea-9aaf-999bccd3e1be service nova] Creating event network-changed:1598d49e-579f-48e5-a374-9f7da048ec3a for instance 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 on hv-cinder-maste Sep 18 00:56:43.095847 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-8b8fcd1c-1f92-49e3-a034-4dbfa1cbba4f req-22c47bca-eb7d-41ea-9aaf-999bccd3e1be service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120686) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 18 00:56:43.096400 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-8b8fcd1c-1f92-49e3-a034-4dbfa1cbba4f req-22c47bca-eb7d-41ea-9aaf-999bccd3e1be service nova] Acquired lock "compute-rpcapi-router" {{(pid=120686) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 18 00:56:43.097602 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f5803090-fb1b-4c21-a384-856506df47af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:43.098256 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f5803090-fb1b-4c21-a384-856506df47af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:43.098912 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f5803090-fb1b-4c21-a384-856506df47af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:43.100523 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f5803090-fb1b-4c21-a384-856506df47af None None] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:43.101223 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f5803090-fb1b-4c21-a384-856506df47af None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:43.101809 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f5803090-fb1b-4c21-a384-856506df47af None None] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:43.129293 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.compute.rpcapi [None req-f5803090-fb1b-4c21-a384-856506df47af None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 18 00:56:43.135046 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f5803090-fb1b-4c21-a384-856506df47af None None] Releasing lock "compute-rpcapi-router" {{(pid=120686) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 18 00:56:43.159956 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f5803090-fb1b-4c21-a384-856506df47af None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155144 Sep 18 00:56:43.161325 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 31/55] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:43.283262 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-09a43b97-d4ec-4589-abb8-23a176a43e5e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:43.284384 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-09a43b97-d4ec-4589-abb8-23a176a43e5e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:43.304998 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a43b97-d4ec-4589-abb8-23a176a43e5e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:43.305491 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a43b97-d4ec-4589-abb8-23a176a43e5e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:43.305924 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a43b97-d4ec-4589-abb8-23a176a43e5e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:43.306838 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a43b97-d4ec-4589-abb8-23a176a43e5e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:43.307462 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a43b97-d4ec-4589-abb8-23a176a43e5e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:43.307904 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a43b97-d4ec-4589-abb8-23a176a43e5e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:43.389163 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=5 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:43.481616 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-09a43b97-d4ec-4589-abb8-23a176a43e5e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:43.485695 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=100 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:43.492765 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-09a43b97-d4ec-4589-abb8-23a176a43e5e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1298 microversion: 2.1 time: 0.214771 Sep 18 00:56:43.503796 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 32/56] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:43 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1298 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:43.515646 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-439eee76-ab11-455d-b842-aac240d7ef34 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:43.516584 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-439eee76-ab11-455d-b842-aac240d7ef34 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:43.524697 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-439eee76-ab11-455d-b842-aac240d7ef34 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:43.525460 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-439eee76-ab11-455d-b842-aac240d7ef34 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:43.526113 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-439eee76-ab11-455d-b842-aac240d7ef34 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:43.527115 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-439eee76-ab11-455d-b842-aac240d7ef34 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:43.527725 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-439eee76-ab11-455d-b842-aac240d7ef34 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:43.528306 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-439eee76-ab11-455d-b842-aac240d7ef34 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:43.752771 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-18fc14f2-cc5b-4180-9077-5434b831f43d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:43.776543 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-18fc14f2-cc5b-4180-9077-5434b831f43d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1322 microversion: 2.1 time: 0.712615 Sep 18 00:56:43.782641 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 25/57] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:43 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1322 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:43.929429 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-d9ddfd03-a141-4a62-9359-de39c7d5a97c req-8f1662de-ec1b-4d12-a82f-04aeb1944274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf75d794-7c36-40e0-a103-db749b9dd1e2", "tag": "f9535f32-8846-4f66-9b5c-30fb801b7fbc"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:43.942034 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-d9ddfd03-a141-4a62-9359-de39c7d5a97c req-8f1662de-ec1b-4d12-a82f-04aeb1944274 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:43.942522 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-d9ddfd03-a141-4a62-9359-de39c7d5a97c req-8f1662de-ec1b-4d12-a82f-04aeb1944274 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:43.943569 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-d9ddfd03-a141-4a62-9359-de39c7d5a97c req-8f1662de-ec1b-4d12-a82f-04aeb1944274 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:43.977355 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-439eee76-ab11-455d-b842-aac240d7ef34 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:43.980512 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-d9ddfd03-a141-4a62-9359-de39c7d5a97c req-8f1662de-ec1b-4d12-a82f-04aeb1944274 service nova] Creating event network-changed:f9535f32-8846-4f66-9b5c-30fb801b7fbc for instance bf75d794-7c36-40e0-a103-db749b9dd1e2 on hv-cinder-maste Sep 18 00:56:43.991762 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-439eee76-ab11-455d-b842-aac240d7ef34 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1314 microversion: 2.1 time: 0.486562 Sep 18 00:56:43.995623 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 33/58] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:43 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:43.998187 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-d9ddfd03-a141-4a62-9359-de39c7d5a97c req-8f1662de-ec1b-4d12-a82f-04aeb1944274 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072514 Sep 18 00:56:43.998809 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 26/59] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:56:44.016475 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3818dcee-2184-42a4-a62b-15ea8120a947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:44.017101 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3818dcee-2184-42a4-a62b-15ea8120a947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:44.026057 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3818dcee-2184-42a4-a62b-15ea8120a947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:44.029437 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3818dcee-2184-42a4-a62b-15ea8120a947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:44.029897 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3818dcee-2184-42a4-a62b-15ea8120a947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:44.030821 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3818dcee-2184-42a4-a62b-15ea8120a947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:44.039992 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3818dcee-2184-42a4-a62b-15ea8120a947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:44.040454 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3818dcee-2184-42a4-a62b-15ea8120a947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:44.062155 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:44.062754 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:44.076404 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:44.076931 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:44.079401 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:44.080476 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:44.080985 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:44.081429 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:44.685224 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:44.687726 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=87 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:44.700156 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:44.701911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:44.708652 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7bf32c70-a159-466a-804f-fc60ee71b8d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.650676 Sep 18 00:56:44.710141 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 27/60] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:44 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:44.722113 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-95945327-7b62-4a47-a372-868233fb3b32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:44.723040 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-95945327-7b62-4a47-a372-868233fb3b32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:44.735087 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3818dcee-2184-42a4-a62b-15ea8120a947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:44.747847 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3818dcee-2184-42a4-a62b-15ea8120a947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1362 microversion: 2.1 time: 0.735114 Sep 18 00:56:44.762051 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 34/61] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:44 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1362 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:44.762141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95945327-7b62-4a47-a372-868233fb3b32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:44.762141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95945327-7b62-4a47-a372-868233fb3b32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:44.762141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95945327-7b62-4a47-a372-868233fb3b32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:44.765424 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95945327-7b62-4a47-a372-868233fb3b32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:44.765424 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95945327-7b62-4a47-a372-868233fb3b32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:44.765424 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95945327-7b62-4a47-a372-868233fb3b32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:44.812655 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a5f200e8-f5ad-4578-bc7a-4b5500fe1748 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:44.814783 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-a5f200e8-f5ad-4578-bc7a-4b5500fe1748 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:44.831681 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5f200e8-f5ad-4578-bc7a-4b5500fe1748 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:44.832390 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5f200e8-f5ad-4578-bc7a-4b5500fe1748 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:44.832988 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5f200e8-f5ad-4578-bc7a-4b5500fe1748 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:44.833762 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5f200e8-f5ad-4578-bc7a-4b5500fe1748 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:44.835350 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5f200e8-f5ad-4578-bc7a-4b5500fe1748 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:44.835350 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5f200e8-f5ad-4578-bc7a-4b5500fe1748 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:45.157757 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-95945327-7b62-4a47-a372-868233fb3b32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:45.168106 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-95945327-7b62-4a47-a372-868233fb3b32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.456537 Sep 18 00:56:45.169663 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 28/62] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:44 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:45.174933 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1b7c5b55-f3be-4113-848a-8079ba0e1f1c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:45.175706 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1b7c5b55-f3be-4113-848a-8079ba0e1f1c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:45.184313 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b7c5b55-f3be-4113-848a-8079ba0e1f1c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:45.185011 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b7c5b55-f3be-4113-848a-8079ba0e1f1c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:45.185621 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b7c5b55-f3be-4113-848a-8079ba0e1f1c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:45.186338 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b7c5b55-f3be-4113-848a-8079ba0e1f1c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:45.187269 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b7c5b55-f3be-4113-848a-8079ba0e1f1c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:45.187412 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b7c5b55-f3be-4113-848a-8079ba0e1f1c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:45.199957 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a5f200e8-f5ad-4578-bc7a-4b5500fe1748 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:45.210997 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a5f200e8-f5ad-4578-bc7a-4b5500fe1748 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1322 microversion: 2.1 time: 0.411547 Sep 18 00:56:45.211848 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 35/63] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:44 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:45.426399 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1b7c5b55-f3be-4113-848a-8079ba0e1f1c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:45.438163 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1b7c5b55-f3be-4113-848a-8079ba0e1f1c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1314 microversion: 2.1 time: 0.267457 Sep 18 00:56:45.439673 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 29/64] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:45 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:45.737578 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:45.738193 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:45.741114 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=6 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:45.750280 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:45.750795 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:45.751673 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:45.752466 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:45.752933 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:45.753349 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:45.773110 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-020542e6-9c87-47e4-bd46-ddf933cba9d7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:45.774283 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-020542e6-9c87-47e4-bd46-ddf933cba9d7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:45.791461 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-020542e6-9c87-47e4-bd46-ddf933cba9d7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:45.792531 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-020542e6-9c87-47e4-bd46-ddf933cba9d7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:45.793331 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-020542e6-9c87-47e4-bd46-ddf933cba9d7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:45.794907 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-020542e6-9c87-47e4-bd46-ddf933cba9d7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:45.796417 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-020542e6-9c87-47e4-bd46-ddf933cba9d7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:45.797074 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-020542e6-9c87-47e4-bd46-ddf933cba9d7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:45.942918 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:45.957940 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:45.970233 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:45.970233 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3c8bc171-73da-46a9-a2d9-4afeb4d8b396 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.230161 Sep 18 00:56:45.989597 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 36/65] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:45 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:46.047534 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-af41c33b-7911-46c2-9962-0acb004a2b65 req-995c84e5-ef1d-4eff-8787-aab8dca78515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2055882-050f-4acf-a99c-96d698e25963", "tag": "ff818f99-6875-42e7-8af0-6e7c1e9ef011"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:46.050203 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-020542e6-9c87-47e4-bd46-ddf933cba9d7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:46.058198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-af41c33b-7911-46c2-9962-0acb004a2b65 req-995c84e5-ef1d-4eff-8787-aab8dca78515 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:46.059148 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-af41c33b-7911-46c2-9962-0acb004a2b65 req-995c84e5-ef1d-4eff-8787-aab8dca78515 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:46.059862 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-af41c33b-7911-46c2-9962-0acb004a2b65 req-995c84e5-ef1d-4eff-8787-aab8dca78515 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:46.064655 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-020542e6-9c87-47e4-bd46-ddf933cba9d7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1362 microversion: 2.1 time: 0.295461 Sep 18 00:56:46.079212 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 30/66] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:45 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:46.099864 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-af41c33b-7911-46c2-9962-0acb004a2b65 req-995c84e5-ef1d-4eff-8787-aab8dca78515 service nova] Creating event network-changed:ff818f99-6875-42e7-8af0-6e7c1e9ef011 for instance e2055882-050f-4acf-a99c-96d698e25963 on hv-cinder-maste Sep 18 00:56:46.105922 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-af41c33b-7911-46c2-9962-0acb004a2b65 req-995c84e5-ef1d-4eff-8787-aab8dca78515 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062432 Sep 18 00:56:46.106869 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 37/67] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:56:46.159811 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-ee1a47cc-e499-45cf-85c4-4a4d97f615b2 req-ce29f37e-503b-46f3-a8fe-730b57e3bf29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5674ad19-62fd-4a3a-98b8-27051ad03cc7", "name": "network-vif-plugged", "status": "completed", "tag": "a8ed2c0d-d075-4325-a1f8-6418484d4934"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:46.177796 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ee1a47cc-e499-45cf-85c4-4a4d97f615b2 req-ce29f37e-503b-46f3-a8fe-730b57e3bf29 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:46.179445 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ee1a47cc-e499-45cf-85c4-4a4d97f615b2 req-ce29f37e-503b-46f3-a8fe-730b57e3bf29 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:46.180197 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ee1a47cc-e499-45cf-85c4-4a4d97f615b2 req-ce29f37e-503b-46f3-a8fe-730b57e3bf29 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:46.193681 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ac033834-212e-47e6-9745-a55db74269c1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:46.194405 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ac033834-212e-47e6-9745-a55db74269c1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:46.195280 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-ee1a47cc-e499-45cf-85c4-4a4d97f615b2 req-ce29f37e-503b-46f3-a8fe-730b57e3bf29 service nova] Creating event network-vif-plugged:a8ed2c0d-d075-4325-a1f8-6418484d4934 for instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 on hv-cinder-maste Sep 18 00:56:46.202456 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-ee1a47cc-e499-45cf-85c4-4a4d97f615b2 req-ce29f37e-503b-46f3-a8fe-730b57e3bf29 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111092 Sep 18 00:56:46.204672 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac033834-212e-47e6-9745-a55db74269c1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:46.205145 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac033834-212e-47e6-9745-a55db74269c1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:46.205571 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac033834-212e-47e6-9745-a55db74269c1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:46.206451 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 31/68] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:56:46.207062 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac033834-212e-47e6-9745-a55db74269c1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:46.207520 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac033834-212e-47e6-9745-a55db74269c1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:46.208042 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac033834-212e-47e6-9745-a55db74269c1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:46.238028 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-459cf25e-66e6-4e26-b5ab-999e988f19bb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:46.238837 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-459cf25e-66e6-4e26-b5ab-999e988f19bb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:46.254401 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-459cf25e-66e6-4e26-b5ab-999e988f19bb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:46.255090 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-459cf25e-66e6-4e26-b5ab-999e988f19bb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:46.261247 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-459cf25e-66e6-4e26-b5ab-999e988f19bb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:46.262330 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-459cf25e-66e6-4e26-b5ab-999e988f19bb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:46.263198 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-459cf25e-66e6-4e26-b5ab-999e988f19bb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:46.263911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-459cf25e-66e6-4e26-b5ab-999e988f19bb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:46.519919 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ac033834-212e-47e6-9745-a55db74269c1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:46.524532 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-459cf25e-66e6-4e26-b5ab-999e988f19bb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:46.534839 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-459cf25e-66e6-4e26-b5ab-999e988f19bb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1322 microversion: 2.1 time: 0.300950 Sep 18 00:56:46.537342 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 32/69] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:46 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:46.544143 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3d47ef1f-49e0-4b02-b232-4366b20fb7d5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:46.545011 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3d47ef1f-49e0-4b02-b232-4366b20fb7d5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:46.562112 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ac033834-212e-47e6-9745-a55db74269c1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.373132 Sep 18 00:56:46.564618 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 38/70] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:46 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:46.577406 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d47ef1f-49e0-4b02-b232-4366b20fb7d5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:46.578243 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d47ef1f-49e0-4b02-b232-4366b20fb7d5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:46.580261 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d47ef1f-49e0-4b02-b232-4366b20fb7d5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:46.581753 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d47ef1f-49e0-4b02-b232-4366b20fb7d5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:46.582365 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d47ef1f-49e0-4b02-b232-4366b20fb7d5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:46.583876 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d47ef1f-49e0-4b02-b232-4366b20fb7d5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:46.995789 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:46.996990 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:47.007558 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:47.008211 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:47.008759 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:47.009723 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:47.010401 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:47.011258 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:47.291974 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3d47ef1f-49e0-4b02-b232-4366b20fb7d5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:47.300749 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3d47ef1f-49e0-4b02-b232-4366b20fb7d5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1314 microversion: 2.1 time: 0.761689 Sep 18 00:56:47.301528 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 33/71] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:46 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:47.307841 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e660e5ac-18aa-4fae-a9c4-ab6fec488b4e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:47.308883 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e660e5ac-18aa-4fae-a9c4-ab6fec488b4e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:47.315756 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e660e5ac-18aa-4fae-a9c4-ab6fec488b4e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:47.316573 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e660e5ac-18aa-4fae-a9c4-ab6fec488b4e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:47.317197 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e660e5ac-18aa-4fae-a9c4-ab6fec488b4e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:47.317952 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e660e5ac-18aa-4fae-a9c4-ab6fec488b4e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:47.318489 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e660e5ac-18aa-4fae-a9c4-ab6fec488b4e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:47.318945 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e660e5ac-18aa-4fae-a9c4-ab6fec488b4e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:47.347499 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:47.358182 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:47.360065 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:47.361209 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-63f1c65c-1591-45ee-b01c-df8b2089f84c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.373619 Sep 18 00:56:47.362084 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 39/72] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:46 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:56:47.470259 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-e660e5ac-18aa-4fae-a9c4-ab6fec488b4e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:47.481760 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e660e5ac-18aa-4fae-a9c4-ab6fec488b4e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1362 microversion: 2.1 time: 0.178041 Sep 18 00:56:47.482670 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 34/73] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:47 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:47.557997 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1922ce1d-5070-491d-987e-5cf9d64fb2fe tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:47.558609 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-1922ce1d-5070-491d-987e-5cf9d64fb2fe tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:47.567169 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1922ce1d-5070-491d-987e-5cf9d64fb2fe tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:47.571858 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1922ce1d-5070-491d-987e-5cf9d64fb2fe tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:47.572574 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1922ce1d-5070-491d-987e-5cf9d64fb2fe tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:47.573313 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1922ce1d-5070-491d-987e-5cf9d64fb2fe tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:47.573846 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1922ce1d-5070-491d-987e-5cf9d64fb2fe tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:47.574783 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1922ce1d-5070-491d-987e-5cf9d64fb2fe tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:47.587378 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-31f686db-03e5-4fba-af48-89775c4ce2a7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:47.588272 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-31f686db-03e5-4fba-af48-89775c4ce2a7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:47.599871 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31f686db-03e5-4fba-af48-89775c4ce2a7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:47.604675 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31f686db-03e5-4fba-af48-89775c4ce2a7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:47.611011 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31f686db-03e5-4fba-af48-89775c4ce2a7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:47.611866 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31f686db-03e5-4fba-af48-89775c4ce2a7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:47.612346 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31f686db-03e5-4fba-af48-89775c4ce2a7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:47.612782 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31f686db-03e5-4fba-af48-89775c4ce2a7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:47.732648 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=8 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:47.875275 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-1922ce1d-5070-491d-987e-5cf9d64fb2fe tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:47.884373 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-1922ce1d-5070-491d-987e-5cf9d64fb2fe tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1322 microversion: 2.1 time: 0.330257 Sep 18 00:56:47.886608 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 40/74] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:47 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:47.954731 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-31f686db-03e5-4fba-af48-89775c4ce2a7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:47.965263 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-31f686db-03e5-4fba-af48-89775c4ce2a7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.382152 Sep 18 00:56:47.983784 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 35/75] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:47 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:48.235818 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-da188386-d1b3-4c3d-baea-a43d7287c0a6 req-4f3f5ac0-c6b1-4a39-9606-d64d0bfab32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf6631e-213a-40ea-8708-5dc51da0ee8c", "name": "network-vif-plugged", "status": "completed", "tag": "caeb66db-fb12-4f3e-b68c-119f4575bc44"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:48.247862 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-da188386-d1b3-4c3d-baea-a43d7287c0a6 req-4f3f5ac0-c6b1-4a39-9606-d64d0bfab32a service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:48.254512 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-da188386-d1b3-4c3d-baea-a43d7287c0a6 req-4f3f5ac0-c6b1-4a39-9606-d64d0bfab32a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:48.260463 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-da188386-d1b3-4c3d-baea-a43d7287c0a6 req-4f3f5ac0-c6b1-4a39-9606-d64d0bfab32a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:48.284084 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-da188386-d1b3-4c3d-baea-a43d7287c0a6 req-4f3f5ac0-c6b1-4a39-9606-d64d0bfab32a service nova] Creating event network-vif-plugged:caeb66db-fb12-4f3e-b68c-119f4575bc44 for instance abf6631e-213a-40ea-8708-5dc51da0ee8c on hv-cinder-maste Sep 18 00:56:48.300636 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-da188386-d1b3-4c3d-baea-a43d7287c0a6 req-4f3f5ac0-c6b1-4a39-9606-d64d0bfab32a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068248 Sep 18 00:56:48.302512 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 41/76] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:48.324878 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e36f43b6-8e1f-4413-a5eb-a61ccfd32757 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:48.325496 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e36f43b6-8e1f-4413-a5eb-a61ccfd32757 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:48.331701 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e36f43b6-8e1f-4413-a5eb-a61ccfd32757 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:48.332431 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e36f43b6-8e1f-4413-a5eb-a61ccfd32757 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:48.333310 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e36f43b6-8e1f-4413-a5eb-a61ccfd32757 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:48.334276 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e36f43b6-8e1f-4413-a5eb-a61ccfd32757 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:48.335114 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e36f43b6-8e1f-4413-a5eb-a61ccfd32757 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:48.335727 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e36f43b6-8e1f-4413-a5eb-a61ccfd32757 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:48.395204 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:48.397907 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:48.412649 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:48.413269 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:48.414486 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:48.416059 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:48.416548 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:48.417349 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:48.763716 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-e36f43b6-8e1f-4413-a5eb-a61ccfd32757 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:48.773369 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e36f43b6-8e1f-4413-a5eb-a61ccfd32757 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1314 microversion: 2.1 time: 0.452435 Sep 18 00:56:48.773951 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 36/77] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:48 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:48.803696 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1b68049a-9129-4749-80ab-b8d8999202da tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:48.804668 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1b68049a-9129-4749-80ab-b8d8999202da tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:48.812066 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b68049a-9129-4749-80ab-b8d8999202da tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:48.812918 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b68049a-9129-4749-80ab-b8d8999202da tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:48.813560 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b68049a-9129-4749-80ab-b8d8999202da tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:48.814482 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b68049a-9129-4749-80ab-b8d8999202da tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:48.815203 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b68049a-9129-4749-80ab-b8d8999202da tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:48.815824 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1b68049a-9129-4749-80ab-b8d8999202da tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:48.829199 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:48.837681 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:48.839157 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:48.840276 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9df773f9-9e32-43bd-8cd4-79e80d043b42 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.451465 Sep 18 00:56:48.857783 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 42/78] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:48 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:48.907518 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f1cb70a6-1896-4924-9e75-4305d2f133de tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:48.908137 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f1cb70a6-1896-4924-9e75-4305d2f133de tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:48.926420 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f1cb70a6-1896-4924-9e75-4305d2f133de tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:48.927665 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f1cb70a6-1896-4924-9e75-4305d2f133de tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:48.928198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f1cb70a6-1896-4924-9e75-4305d2f133de tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:48.928912 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f1cb70a6-1896-4924-9e75-4305d2f133de tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:48.929546 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f1cb70a6-1896-4924-9e75-4305d2f133de tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:48.930133 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f1cb70a6-1896-4924-9e75-4305d2f133de tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:49.378597 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1b68049a-9129-4749-80ab-b8d8999202da tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:49.387744 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1b68049a-9129-4749-80ab-b8d8999202da tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1362 microversion: 2.1 time: 0.610970 Sep 18 00:56:49.388530 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 37/79] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:48 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1362 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:49.413265 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-919eba69-5d28-4bb7-b143-e0f6c28a193a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:49.414434 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-919eba69-5d28-4bb7-b143-e0f6c28a193a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:49.420958 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-919eba69-5d28-4bb7-b143-e0f6c28a193a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:49.421807 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-919eba69-5d28-4bb7-b143-e0f6c28a193a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:49.422473 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-919eba69-5d28-4bb7-b143-e0f6c28a193a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:49.423514 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-919eba69-5d28-4bb7-b143-e0f6c28a193a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:49.424116 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-919eba69-5d28-4bb7-b143-e0f6c28a193a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:49.424843 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-919eba69-5d28-4bb7-b143-e0f6c28a193a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:49.696358 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f1cb70a6-1896-4924-9e75-4305d2f133de tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:49.707093 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f1cb70a6-1896-4924-9e75-4305d2f133de tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1322 microversion: 2.1 time: 0.803141 Sep 18 00:56:49.709282 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 43/80] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:48 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1322 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:49.782558 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-919eba69-5d28-4bb7-b143-e0f6c28a193a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:49.791680 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-919eba69-5d28-4bb7-b143-e0f6c28a193a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.384750 Sep 18 00:56:49.807184 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 38/81] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:49 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:49.807403 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-43c70646-f5cf-453b-ac99-76918abc536f tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:49.807403 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-43c70646-f5cf-453b-ac99-76918abc536f tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:49.813361 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43c70646-f5cf-453b-ac99-76918abc536f tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:49.830698 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43c70646-f5cf-453b-ac99-76918abc536f tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:49.832421 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43c70646-f5cf-453b-ac99-76918abc536f tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:49.834601 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43c70646-f5cf-453b-ac99-76918abc536f tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:49.837343 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43c70646-f5cf-453b-ac99-76918abc536f tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:49.837790 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43c70646-f5cf-453b-ac99-76918abc536f tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:49.870286 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:49.870992 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:49.890513 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:49.894168 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:49.894784 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:49.900208 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:49.900974 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:49.902390 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:50.275618 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-43c70646-f5cf-453b-ac99-76918abc536f tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:50.283370 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-43c70646-f5cf-453b-ac99-76918abc536f tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1314 microversion: 2.1 time: 0.490329 Sep 18 00:56:50.299154 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 44/82] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:49 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:50.317141 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-bd463091-e557-4d07-a91f-5c76a3d6c310 req-706008e6-16ae-4e20-af33-b0f73f629e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf75d794-7c36-40e0-a103-db749b9dd1e2", "name": "network-vif-plugged", "status": "completed", "tag": "f9535f32-8846-4f66-9b5c-30fb801b7fbc"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:50.328744 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-bd463091-e557-4d07-a91f-5c76a3d6c310 req-706008e6-16ae-4e20-af33-b0f73f629e76 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:50.329480 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-bd463091-e557-4d07-a91f-5c76a3d6c310 req-706008e6-16ae-4e20-af33-b0f73f629e76 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:50.330140 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-bd463091-e557-4d07-a91f-5c76a3d6c310 req-706008e6-16ae-4e20-af33-b0f73f629e76 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:50.352103 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-bd463091-e557-4d07-a91f-5c76a3d6c310 req-706008e6-16ae-4e20-af33-b0f73f629e76 service nova] Creating event network-vif-plugged:f9535f32-8846-4f66-9b5c-30fb801b7fbc for instance bf75d794-7c36-40e0-a103-db749b9dd1e2 on hv-cinder-maste Sep 18 00:56:50.362898 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-bd463091-e557-4d07-a91f-5c76a3d6c310 req-706008e6-16ae-4e20-af33-b0f73f629e76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049221 Sep 18 00:56:50.364939 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 45/83] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:56:50.399971 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:50.409805 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:50.411845 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:50.413289 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9bd92698-5b51-42d0-9fe9-5dc2ee4d02a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.550225 Sep 18 00:56:50.423203 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f9ed604f-ff34-4e51-917e-665d13765012 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:50.424832 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f9ed604f-ff34-4e51-917e-665d13765012 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:50.427974 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 39/84] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:49 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:50.438080 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f9ed604f-ff34-4e51-917e-665d13765012 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:50.438747 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f9ed604f-ff34-4e51-917e-665d13765012 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:50.439614 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f9ed604f-ff34-4e51-917e-665d13765012 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:50.440705 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f9ed604f-ff34-4e51-917e-665d13765012 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:50.441434 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f9ed604f-ff34-4e51-917e-665d13765012 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:50.442854 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f9ed604f-ff34-4e51-917e-665d13765012 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:50.634323 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f9ed604f-ff34-4e51-917e-665d13765012 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:50.643094 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f9ed604f-ff34-4e51-917e-665d13765012 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1362 microversion: 2.1 time: 0.233971 Sep 18 00:56:50.643729 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 46/85] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:50 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:50.732260 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3a0e625c-7434-4030-8f09-7d23dc228e95 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:50.732590 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3a0e625c-7434-4030-8f09-7d23dc228e95 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:50.742752 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a0e625c-7434-4030-8f09-7d23dc228e95 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:50.743360 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a0e625c-7434-4030-8f09-7d23dc228e95 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:50.744012 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a0e625c-7434-4030-8f09-7d23dc228e95 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:50.744808 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a0e625c-7434-4030-8f09-7d23dc228e95 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:50.745336 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a0e625c-7434-4030-8f09-7d23dc228e95 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:50.745750 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a0e625c-7434-4030-8f09-7d23dc228e95 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:50.820485 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2633634f-cd11-44e4-8391-293324f23ec6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:50.821674 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-2633634f-cd11-44e4-8391-293324f23ec6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:50.830726 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2633634f-cd11-44e4-8391-293324f23ec6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:50.831339 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2633634f-cd11-44e4-8391-293324f23ec6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:50.831856 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2633634f-cd11-44e4-8391-293324f23ec6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:50.832770 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2633634f-cd11-44e4-8391-293324f23ec6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:50.833860 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2633634f-cd11-44e4-8391-293324f23ec6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:50.834358 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2633634f-cd11-44e4-8391-293324f23ec6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:50.968832 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3a0e625c-7434-4030-8f09-7d23dc228e95 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:50.982060 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3a0e625c-7434-4030-8f09-7d23dc228e95 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1322 microversion: 2.1 time: 0.253614 Sep 18 00:56:50.996599 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 40/86] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:50 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:51.175318 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2633634f-cd11-44e4-8391-293324f23ec6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:51.184931 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2633634f-cd11-44e4-8391-293324f23ec6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.373004 Sep 18 00:56:51.185870 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 47/87] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:50 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:51.306352 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-95f82aba-d5fe-4bb9-b10a-fd8f0573c48b tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:51.307190 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-95f82aba-d5fe-4bb9-b10a-fd8f0573c48b tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:51.314737 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f82aba-d5fe-4bb9-b10a-fd8f0573c48b tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:51.315639 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f82aba-d5fe-4bb9-b10a-fd8f0573c48b tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:51.316864 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f82aba-d5fe-4bb9-b10a-fd8f0573c48b tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:51.318115 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f82aba-d5fe-4bb9-b10a-fd8f0573c48b tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:51.318766 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f82aba-d5fe-4bb9-b10a-fd8f0573c48b tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:51.319602 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f82aba-d5fe-4bb9-b10a-fd8f0573c48b tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:51.439975 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:51.440584 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:51.452588 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:51.453191 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:51.453628 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:51.454334 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:51.454783 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:51.460087 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:51.503448 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-95f82aba-d5fe-4bb9-b10a-fd8f0573c48b tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:51.518105 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-95f82aba-d5fe-4bb9-b10a-fd8f0573c48b tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1501 microversion: 2.1 time: 0.216596 Sep 18 00:56:51.518856 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 41/88] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:51 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1501 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:51.666557 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e68e7a47-e1b9-4910-8488-57bfc051019e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:51.667514 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e68e7a47-e1b9-4910-8488-57bfc051019e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:51.679701 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e68e7a47-e1b9-4910-8488-57bfc051019e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:51.680218 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e68e7a47-e1b9-4910-8488-57bfc051019e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:51.680657 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e68e7a47-e1b9-4910-8488-57bfc051019e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:51.681368 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e68e7a47-e1b9-4910-8488-57bfc051019e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:51.681823 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e68e7a47-e1b9-4910-8488-57bfc051019e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:51.685861 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e68e7a47-e1b9-4910-8488-57bfc051019e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:51.748079 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:51.763266 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:51.766457 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:51.774537 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-80ec9388-dd55-4008-a5a8-812a6bac8e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.338667 Sep 18 00:56:51.777846 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 48/89] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:51 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:56:51.925442 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-e68e7a47-e1b9-4910-8488-57bfc051019e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:51.935975 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e68e7a47-e1b9-4910-8488-57bfc051019e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1549 microversion: 2.1 time: 0.274027 Sep 18 00:56:51.936807 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 42/90] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:51 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1549 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:51.971635 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-96e06c9f-c610-4651-b5d6-e8fd22b0d039 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:51.972141 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-96e06c9f-c610-4651-b5d6-e8fd22b0d039 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:51.988058 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96e06c9f-c610-4651-b5d6-e8fd22b0d039 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:51.992010 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96e06c9f-c610-4651-b5d6-e8fd22b0d039 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:51.994875 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96e06c9f-c610-4651-b5d6-e8fd22b0d039 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:51.996244 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96e06c9f-c610-4651-b5d6-e8fd22b0d039 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:51.996739 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96e06c9f-c610-4651-b5d6-e8fd22b0d039 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:51.997179 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96e06c9f-c610-4651-b5d6-e8fd22b0d039 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:52.010396 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8eb53200-ed40-457d-bbff-418bd71438b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:52.011163 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8eb53200-ed40-457d-bbff-418bd71438b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:52.025688 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8eb53200-ed40-457d-bbff-418bd71438b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:52.026573 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8eb53200-ed40-457d-bbff-418bd71438b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:52.027074 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8eb53200-ed40-457d-bbff-418bd71438b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:52.027814 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8eb53200-ed40-457d-bbff-418bd71438b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:52.028276 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8eb53200-ed40-457d-bbff-418bd71438b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:52.028800 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8eb53200-ed40-457d-bbff-418bd71438b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:52.218650 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-96e06c9f-c610-4651-b5d6-e8fd22b0d039 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.258034 Sep 18 00:56:52.219843 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 49/91] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 18 00:56:51 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/os-interface => generated 285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:52.227164 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e36c5783-2739-4eb5-accb-9df75ac895bb tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:52.228095 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e36c5783-2739-4eb5-accb-9df75ac895bb tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:52.237538 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e36c5783-2739-4eb5-accb-9df75ac895bb tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:52.238434 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e36c5783-2739-4eb5-accb-9df75ac895bb tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:52.239405 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e36c5783-2739-4eb5-accb-9df75ac895bb tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:52.240341 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e36c5783-2739-4eb5-accb-9df75ac895bb tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:52.241085 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e36c5783-2739-4eb5-accb-9df75ac895bb tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:52.241706 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e36c5783-2739-4eb5-accb-9df75ac895bb tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:52.256728 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8eb53200-ed40-457d-bbff-418bd71438b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:52.268567 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8eb53200-ed40-457d-bbff-418bd71438b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1322 microversion: 2.1 time: 0.262574 Sep 18 00:56:52.269340 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 43/92] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:52 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:52.415074 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e36c5783-2739-4eb5-accb-9df75ac895bb tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:52.429936 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e36c5783-2739-4eb5-accb-9df75ac895bb tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.208456 Sep 18 00:56:52.431143 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 50/93] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:52 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:52.800058 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:52.800663 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:52.813210 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:52.813789 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:52.814293 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:52.815099 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:52.816440 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:52.819303 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:52.829986 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-b422aaa1-1bf7-46b6-8e0c-e7fd6149e2f0 req-5d67813e-440e-456e-9724-9452db2249ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728", "name": "network-vif-plugged", "status": "completed", "tag": "1598d49e-579f-48e5-a374-9f7da048ec3a"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:52.854091 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-b422aaa1-1bf7-46b6-8e0c-e7fd6149e2f0 req-5d67813e-440e-456e-9724-9452db2249ba service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:52.857416 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-b422aaa1-1bf7-46b6-8e0c-e7fd6149e2f0 req-5d67813e-440e-456e-9724-9452db2249ba service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:52.857860 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-b422aaa1-1bf7-46b6-8e0c-e7fd6149e2f0 req-5d67813e-440e-456e-9724-9452db2249ba service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:52.884887 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-b422aaa1-1bf7-46b6-8e0c-e7fd6149e2f0 req-5d67813e-440e-456e-9724-9452db2249ba service nova] Creating event network-vif-plugged:1598d49e-579f-48e5-a374-9f7da048ec3a for instance 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 on hv-cinder-maste Sep 18 00:56:52.897625 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-b422aaa1-1bf7-46b6-8e0c-e7fd6149e2f0 req-5d67813e-440e-456e-9724-9452db2249ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070821 Sep 18 00:56:52.900352 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 51/94] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:53.058700 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:53.073130 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:53.075192 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:53.076501 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0511b8f4-b5bf-485f-a4dd-54e0cb08f7b8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.280423 Sep 18 00:56:53.077216 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 44/95] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:52 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:53.182901 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e37c89b5-e66d-4e30-82ea-31bec37387e2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45df40a9-e312-4ec8-8140-dbfde1ae1415"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:53.185583 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e37c89b5-e66d-4e30-82ea-31bec37387e2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:53.191461 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=4 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:53.203816 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e37c89b5-e66d-4e30-82ea-31bec37387e2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:53.210315 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e37c89b5-e66d-4e30-82ea-31bec37387e2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:53.211600 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e37c89b5-e66d-4e30-82ea-31bec37387e2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:53.212539 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e37c89b5-e66d-4e30-82ea-31bec37387e2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:53.213158 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e37c89b5-e66d-4e30-82ea-31bec37387e2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:53.216372 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e37c89b5-e66d-4e30-82ea-31bec37387e2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:53.251742 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=100 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:53.295285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-2353bd93-9f1d-4697-a41b-ab4065e36630 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:53.295921 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-2353bd93-9f1d-4697-a41b-ab4065e36630 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:53.312045 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2353bd93-9f1d-4697-a41b-ab4065e36630 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:53.314442 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2353bd93-9f1d-4697-a41b-ab4065e36630 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:53.315162 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2353bd93-9f1d-4697-a41b-ab4065e36630 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:53.317783 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2353bd93-9f1d-4697-a41b-ab4065e36630 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:53.318397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2353bd93-9f1d-4697-a41b-ab4065e36630 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:53.322807 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2353bd93-9f1d-4697-a41b-ab4065e36630 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:53.330442 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=100 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:53.580088 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-2353bd93-9f1d-4697-a41b-ab4065e36630 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:53.590773 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-2353bd93-9f1d-4697-a41b-ab4065e36630 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1322 microversion: 2.1 time: 0.301141 Sep 18 00:56:53.591394 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 45/96] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:53 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:53.598255 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1db1fe7c-2e39-49e1-b218-285f93b20b84 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:53.599856 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1db1fe7c-2e39-49e1-b218-285f93b20b84 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:53.609076 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1db1fe7c-2e39-49e1-b218-285f93b20b84 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:53.609622 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1db1fe7c-2e39-49e1-b218-285f93b20b84 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:53.610061 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1db1fe7c-2e39-49e1-b218-285f93b20b84 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:53.610767 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1db1fe7c-2e39-49e1-b218-285f93b20b84 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:53.611250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1db1fe7c-2e39-49e1-b218-285f93b20b84 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:53.611674 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1db1fe7c-2e39-49e1-b218-285f93b20b84 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:53.878627 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1db1fe7c-2e39-49e1-b218-285f93b20b84 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:53.889403 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1db1fe7c-2e39-49e1-b218-285f93b20b84 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.296894 Sep 18 00:56:53.898893 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 46/97] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:53 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:53.943005 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e37c89b5-e66d-4e30-82ea-31bec37387e2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "POST /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765492 Sep 18 00:56:53.944159 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 52/98] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 00:56:53 2022] POST /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:54.109630 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:54.110926 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:54.119896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:54.120854 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:54.121514 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:54.122651 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:54.123389 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:54.124052 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:54.292433 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:54.304532 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:54.306371 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:54.308153 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-fe7ef658-e5fc-4554-8c61-2495e00724b2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.204912 Sep 18 00:56:54.309171 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 47/99] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:54 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:54.348080 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-00ca91a2-8332-4485-922e-76d94958cc81 req-7e7ddce9-9c07-4d8d-a68b-f4d8851a9da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf6631e-213a-40ea-8708-5dc51da0ee8c", "tag": "caeb66db-fb12-4f3e-b68c-119f4575bc44"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:54.371156 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-00ca91a2-8332-4485-922e-76d94958cc81 req-7e7ddce9-9c07-4d8d-a68b-f4d8851a9da3 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:54.375079 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-00ca91a2-8332-4485-922e-76d94958cc81 req-7e7ddce9-9c07-4d8d-a68b-f4d8851a9da3 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:54.375551 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-00ca91a2-8332-4485-922e-76d94958cc81 req-7e7ddce9-9c07-4d8d-a68b-f4d8851a9da3 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:54.393929 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-00ca91a2-8332-4485-922e-76d94958cc81 req-7e7ddce9-9c07-4d8d-a68b-f4d8851a9da3 service nova] Creating event network-changed:caeb66db-fb12-4f3e-b68c-119f4575bc44 for instance abf6631e-213a-40ea-8708-5dc51da0ee8c on hv-cinder-maste Sep 18 00:56:54.400458 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-00ca91a2-8332-4485-922e-76d94958cc81 req-7e7ddce9-9c07-4d8d-a68b-f4d8851a9da3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058094 Sep 18 00:56:54.401359 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 53/100] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:54.615710 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f2f3b74a-c37d-4dbb-aba2-aea7dc122526 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:54.616526 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f2f3b74a-c37d-4dbb-aba2-aea7dc122526 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:54.626594 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2f3b74a-c37d-4dbb-aba2-aea7dc122526 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:54.631808 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2f3b74a-c37d-4dbb-aba2-aea7dc122526 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:54.633551 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2f3b74a-c37d-4dbb-aba2-aea7dc122526 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:54.636082 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2f3b74a-c37d-4dbb-aba2-aea7dc122526 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:54.637490 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2f3b74a-c37d-4dbb-aba2-aea7dc122526 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:54.638093 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2f3b74a-c37d-4dbb-aba2-aea7dc122526 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:54.917070 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1e456aa8-939c-4e0f-820a-9894b43ecdf7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:54.918055 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-1e456aa8-939c-4e0f-820a-9894b43ecdf7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:54.934465 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1e456aa8-939c-4e0f-820a-9894b43ecdf7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:54.936317 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1e456aa8-939c-4e0f-820a-9894b43ecdf7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:54.937680 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1e456aa8-939c-4e0f-820a-9894b43ecdf7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:54.941883 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1e456aa8-939c-4e0f-820a-9894b43ecdf7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:54.942785 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1e456aa8-939c-4e0f-820a-9894b43ecdf7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:54.943603 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1e456aa8-939c-4e0f-820a-9894b43ecdf7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:54.949553 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f2f3b74a-c37d-4dbb-aba2-aea7dc122526 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:54.982884 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f2f3b74a-c37d-4dbb-aba2-aea7dc122526 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1322 microversion: 2.1 time: 0.371330 Sep 18 00:56:54.993263 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 48/101] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:54 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:54.998829 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-2e78e994-89dd-4ded-83de-e1e3da1d2d43 req-8e81e790-79bb-4485-abe0-263fada53906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cf145a-d8d5-4a7e-937b-729bf79629fa", "name": "network-vif-plugged", "status": "completed", "tag": "3b10ed6a-bc95-40e6-afaa-4936e44594eb"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:55.030267 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-2e78e994-89dd-4ded-83de-e1e3da1d2d43 req-8e81e790-79bb-4485-abe0-263fada53906 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:55.030764 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-2e78e994-89dd-4ded-83de-e1e3da1d2d43 req-8e81e790-79bb-4485-abe0-263fada53906 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:55.031621 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-2e78e994-89dd-4ded-83de-e1e3da1d2d43 req-8e81e790-79bb-4485-abe0-263fada53906 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:55.058247 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-2e78e994-89dd-4ded-83de-e1e3da1d2d43 req-8e81e790-79bb-4485-abe0-263fada53906 service nova] Creating event network-vif-plugged:3b10ed6a-bc95-40e6-afaa-4936e44594eb for instance c1cf145a-d8d5-4a7e-937b-729bf79629fa on hv-cinder-maste Sep 18 00:56:55.073487 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-2e78e994-89dd-4ded-83de-e1e3da1d2d43 req-8e81e790-79bb-4485-abe0-263fada53906 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078052 Sep 18 00:56:55.074846 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 49/102] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:55.205018 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-1e456aa8-939c-4e0f-820a-9894b43ecdf7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:55.214468 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-1e456aa8-939c-4e0f-820a-9894b43ecdf7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.304721 Sep 18 00:56:55.215951 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 54/103] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:54 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:55.339096 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:55.339950 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:55.350978 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:55.351754 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:55.352192 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:55.353346 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:55.353861 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:55.354992 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:55.715980 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:55.731200 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:55.732730 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:55.738355 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0438f252-9b4c-476b-984d-531452d94e5e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.408097 Sep 18 00:56:55.741435 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 50/104] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:55 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:56.019490 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-233ddad7-788b-4da3-a52b-215556c5387d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:56.020055 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-233ddad7-788b-4da3-a52b-215556c5387d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:56.029804 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-233ddad7-788b-4da3-a52b-215556c5387d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:56.030300 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-233ddad7-788b-4da3-a52b-215556c5387d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:56.031127 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-233ddad7-788b-4da3-a52b-215556c5387d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:56.031477 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-233ddad7-788b-4da3-a52b-215556c5387d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:56.031931 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-233ddad7-788b-4da3-a52b-215556c5387d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:56.037800 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-233ddad7-788b-4da3-a52b-215556c5387d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:56.241955 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-234aca09-d0ee-48f8-b691-698d8d065d32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:56.242601 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-234aca09-d0ee-48f8-b691-698d8d065d32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:56.263006 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-234aca09-d0ee-48f8-b691-698d8d065d32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:56.263594 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-234aca09-d0ee-48f8-b691-698d8d065d32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:56.264046 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-234aca09-d0ee-48f8-b691-698d8d065d32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:56.264775 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-234aca09-d0ee-48f8-b691-698d8d065d32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:56.265267 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-234aca09-d0ee-48f8-b691-698d8d065d32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:56.265694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-234aca09-d0ee-48f8-b691-698d8d065d32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:56.274991 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-233ddad7-788b-4da3-a52b-215556c5387d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:56.288545 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-233ddad7-788b-4da3-a52b-215556c5387d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1517 microversion: 2.1 time: 0.272123 Sep 18 00:56:56.289690 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 55/105] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:56 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1517 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:56.315238 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7838da62-e4cb-4ce9-83a7-da9e79f36b4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:56.322823 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7838da62-e4cb-4ce9-83a7-da9e79f36b4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:56.342531 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7838da62-e4cb-4ce9-83a7-da9e79f36b4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:56.345179 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7838da62-e4cb-4ce9-83a7-da9e79f36b4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:56.345779 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7838da62-e4cb-4ce9-83a7-da9e79f36b4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:56.350855 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7838da62-e4cb-4ce9-83a7-da9e79f36b4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:56.351496 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7838da62-e4cb-4ce9-83a7-da9e79f36b4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:56.352404 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7838da62-e4cb-4ce9-83a7-da9e79f36b4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:56.400985 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-7838da62-e4cb-4ce9-83a7-da9e79f36b4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lazy-loading 'flavor' on Instance uuid 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:56:56.523397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-234aca09-d0ee-48f8-b691-698d8d065d32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:56.535546 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-234aca09-d0ee-48f8-b691-698d8d065d32 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.301624 Sep 18 00:56:56.536873 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 51/106] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:56 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:56.624893 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7838da62-e4cb-4ce9-83a7-da9e79f36b4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "POST /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728/action" status: 200 len: 32 microversion: 2.1 time: 0.313600 Sep 18 00:56:56.625528 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 56/107] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 00:56:56 2022] POST /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 18 00:56:56.642577 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7c5d5246-7663-4178-8b4f-f40a5bc0cef2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:56.644177 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7c5d5246-7663-4178-8b4f-f40a5bc0cef2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:56.655623 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7c5d5246-7663-4178-8b4f-f40a5bc0cef2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:56.656504 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7c5d5246-7663-4178-8b4f-f40a5bc0cef2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:56.657288 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7c5d5246-7663-4178-8b4f-f40a5bc0cef2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:56.658961 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7c5d5246-7663-4178-8b4f-f40a5bc0cef2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:56.660229 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7c5d5246-7663-4178-8b4f-f40a5bc0cef2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:56.661080 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7c5d5246-7663-4178-8b4f-f40a5bc0cef2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:56.768855 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:56.769487 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:56.791172 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:56.791668 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:56.792152 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:56.792794 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:56.793245 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:56.793666 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:56.921855 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7c5d5246-7663-4178-8b4f-f40a5bc0cef2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:56.938408 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7c5d5246-7663-4178-8b4f-f40a5bc0cef2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.305434 Sep 18 00:56:56.943919 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 52/108] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:56 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:57.091944 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:57.104476 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:57.107353 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:57.108812 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-196a1de0-44e8-4cf2-8edf-2f5203973d29 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.345337 Sep 18 00:56:57.109921 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 57/109] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:56 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:56:57.560241 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-149b6aac-3baf-484d-a352-cc3164538e22 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:57.560911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-149b6aac-3baf-484d-a352-cc3164538e22 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:57.569282 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-149b6aac-3baf-484d-a352-cc3164538e22 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:57.569940 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-149b6aac-3baf-484d-a352-cc3164538e22 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:57.570511 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-149b6aac-3baf-484d-a352-cc3164538e22 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:57.571378 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-149b6aac-3baf-484d-a352-cc3164538e22 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:57.572568 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-149b6aac-3baf-484d-a352-cc3164538e22 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:57.573986 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-149b6aac-3baf-484d-a352-cc3164538e22 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:57.731078 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-149b6aac-3baf-484d-a352-cc3164538e22 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:57.740356 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-149b6aac-3baf-484d-a352-cc3164538e22 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.185309 Sep 18 00:56:57.741624 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 53/110] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:57 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:57.977213 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f845e80f-45d5-4cd9-81ab-868639ccc68a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:57.977826 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f845e80f-45d5-4cd9-81ab-868639ccc68a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:57.990731 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f845e80f-45d5-4cd9-81ab-868639ccc68a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:57.991124 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f845e80f-45d5-4cd9-81ab-868639ccc68a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:57.991739 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f845e80f-45d5-4cd9-81ab-868639ccc68a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:57.992743 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f845e80f-45d5-4cd9-81ab-868639ccc68a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:57.993982 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f845e80f-45d5-4cd9-81ab-868639ccc68a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:57.994930 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f845e80f-45d5-4cd9-81ab-868639ccc68a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:58.142306 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:58.143274 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:58.151001 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:58.151520 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:58.151985 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:58.152861 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:58.155035 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:58.156372 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:58.283002 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f845e80f-45d5-4cd9-81ab-868639ccc68a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:58.294223 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f845e80f-45d5-4cd9-81ab-868639ccc68a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.336490 Sep 18 00:56:58.295739 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 58/111] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:57 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:58.301107 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-071aab11-ce42-4cfb-9382-dbdade6cce21 req-76befca5-bbb4-46c3-8e7b-a98929f6b9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2055882-050f-4acf-a99c-96d698e25963", "name": "network-vif-plugged", "status": "completed", "tag": "ff818f99-6875-42e7-8af0-6e7c1e9ef011"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:56:58.311608 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-071aab11-ce42-4cfb-9382-dbdade6cce21 req-76befca5-bbb4-46c3-8e7b-a98929f6b9fc service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:58.312343 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-071aab11-ce42-4cfb-9382-dbdade6cce21 req-76befca5-bbb4-46c3-8e7b-a98929f6b9fc service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:58.312993 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-071aab11-ce42-4cfb-9382-dbdade6cce21 req-76befca5-bbb4-46c3-8e7b-a98929f6b9fc service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:58.325927 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-071aab11-ce42-4cfb-9382-dbdade6cce21 req-76befca5-bbb4-46c3-8e7b-a98929f6b9fc service nova] Creating event network-vif-plugged:ff818f99-6875-42e7-8af0-6e7c1e9ef011 for instance e2055882-050f-4acf-a99c-96d698e25963 on hv-cinder-maste Sep 18 00:56:58.330779 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-071aab11-ce42-4cfb-9382-dbdade6cce21 req-76befca5-bbb4-46c3-8e7b-a98929f6b9fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033322 Sep 18 00:56:58.331398 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 59/112] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:56:58.348569 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:58.358284 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:58.360217 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:58.362319 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c0789556-0e9d-438f-a667-1b691550c1e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.225049 Sep 18 00:56:58.363206 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 54/113] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:58 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:56:58.469675 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8486bffc-b299-4010-9667-b64b267d0062 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:58.470262 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8486bffc-b299-4010-9667-b64b267d0062 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:58.477574 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8486bffc-b299-4010-9667-b64b267d0062 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:58.478129 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8486bffc-b299-4010-9667-b64b267d0062 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:58.478582 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8486bffc-b299-4010-9667-b64b267d0062 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:58.479424 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8486bffc-b299-4010-9667-b64b267d0062 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:58.479883 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8486bffc-b299-4010-9667-b64b267d0062 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:58.480315 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8486bffc-b299-4010-9667-b64b267d0062 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:58.506896 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8486bffc-b299-4010-9667-b64b267d0062 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Going to try to terminate instance {{(pid=120686) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 00:56:58.610144 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8486bffc-b299-4010-9667-b64b267d0062 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 204 len: 0 microversion: 2.1 time: 0.144240 Sep 18 00:56:58.611495 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 60/114] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 00:56:58 2022] DELETE /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 00:56:58.619859 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-26c4ab39-f80a-4db7-904b-074307515a5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:58.621156 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-26c4ab39-f80a-4db7-904b-074307515a5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:58.635065 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-26c4ab39-f80a-4db7-904b-074307515a5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:58.635798 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-26c4ab39-f80a-4db7-904b-074307515a5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:58.636682 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-26c4ab39-f80a-4db7-904b-074307515a5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:58.637703 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-26c4ab39-f80a-4db7-904b-074307515a5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:58.638324 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-26c4ab39-f80a-4db7-904b-074307515a5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:58.638955 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-26c4ab39-f80a-4db7-904b-074307515a5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:58.765417 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-6c1c8b7c-4b26-440e-ba5c-dab3178a1317 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:58.766690 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6c1c8b7c-4b26-440e-ba5c-dab3178a1317 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:58.774028 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6c1c8b7c-4b26-440e-ba5c-dab3178a1317 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:58.774609 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6c1c8b7c-4b26-440e-ba5c-dab3178a1317 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:58.775493 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6c1c8b7c-4b26-440e-ba5c-dab3178a1317 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:58.775973 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6c1c8b7c-4b26-440e-ba5c-dab3178a1317 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:58.776513 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6c1c8b7c-4b26-440e-ba5c-dab3178a1317 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:58.777006 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6c1c8b7c-4b26-440e-ba5c-dab3178a1317 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:58.868608 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-26c4ab39-f80a-4db7-904b-074307515a5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:58.877257 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-26c4ab39-f80a-4db7-904b-074307515a5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1553 microversion: 2.1 time: 0.261442 Sep 18 00:56:58.877841 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 55/115] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:58 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:58.934031 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6c1c8b7c-4b26-440e-ba5c-dab3178a1317 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:58.941586 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-6c1c8b7c-4b26-440e-ba5c-dab3178a1317 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.180579 Sep 18 00:56:58.942976 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 61/116] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:58 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:56:59.319100 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0865531c-c4b9-4c76-baf7-fe5f378dc0ec tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:59.319706 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0865531c-c4b9-4c76-baf7-fe5f378dc0ec tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:59.321745 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:59.328129 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0865531c-c4b9-4c76-baf7-fe5f378dc0ec tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:59.328779 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0865531c-c4b9-4c76-baf7-fe5f378dc0ec tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:59.329480 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0865531c-c4b9-4c76-baf7-fe5f378dc0ec tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:59.330293 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0865531c-c4b9-4c76-baf7-fe5f378dc0ec tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:59.330887 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0865531c-c4b9-4c76-baf7-fe5f378dc0ec tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:59.331936 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0865531c-c4b9-4c76-baf7-fe5f378dc0ec tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:59.392750 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:59.393302 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:59.401959 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:59.403107 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:59.403566 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:59.404276 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:59.404914 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:59.405426 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:59.547145 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0865531c-c4b9-4c76-baf7-fe5f378dc0ec tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:59.556002 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0865531c-c4b9-4c76-baf7-fe5f378dc0ec tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.240929 Sep 18 00:56:59.569251 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 56/117] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:59 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:56:59.589482 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:59.598242 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:59.600061 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:56:59.601294 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2357e373-9f31-4f48-ad21-0802f2488627 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.213029 Sep 18 00:56:59.602109 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 62/118] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:56:59 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:56:59.901894 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-71fb819c-14ed-4611-bab4-2a094e058d5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:59.903082 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-71fb819c-14ed-4611-bab4-2a094e058d5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:59.911250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-71fb819c-14ed-4611-bab4-2a094e058d5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:59.911250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-71fb819c-14ed-4611-bab4-2a094e058d5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:59.911250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-71fb819c-14ed-4611-bab4-2a094e058d5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:59.911652 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-71fb819c-14ed-4611-bab4-2a094e058d5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:59.915038 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-71fb819c-14ed-4611-bab4-2a094e058d5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:59.915485 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-71fb819c-14ed-4611-bab4-2a094e058d5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:59.967455 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-26815977-e776-4f7f-8205-b88d2cd64bd3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:56:59.968508 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-26815977-e776-4f7f-8205-b88d2cd64bd3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:56:59.979094 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26815977-e776-4f7f-8205-b88d2cd64bd3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:59.979595 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26815977-e776-4f7f-8205-b88d2cd64bd3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:59.980032 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26815977-e776-4f7f-8205-b88d2cd64bd3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:56:59.980745 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26815977-e776-4f7f-8205-b88d2cd64bd3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:56:59.981201 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26815977-e776-4f7f-8205-b88d2cd64bd3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:56:59.981628 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26815977-e776-4f7f-8205-b88d2cd64bd3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:00.162206 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-71fb819c-14ed-4611-bab4-2a094e058d5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:00.177238 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-71fb819c-14ed-4611-bab4-2a094e058d5c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1553 microversion: 2.1 time: 0.279115 Sep 18 00:57:00.189058 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 57/119] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:59 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1553 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:00.192738 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-26815977-e776-4f7f-8205-b88d2cd64bd3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:00.204324 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-26815977-e776-4f7f-8205-b88d2cd64bd3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.242508 Sep 18 00:57:00.215772 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 63/120] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:56:59 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:00.579569 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3bb54fab-6edf-4122-a6a6-8c9eb76273bd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:00.580183 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3bb54fab-6edf-4122-a6a6-8c9eb76273bd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:00.600230 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bb54fab-6edf-4122-a6a6-8c9eb76273bd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:00.601599 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bb54fab-6edf-4122-a6a6-8c9eb76273bd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:00.601599 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bb54fab-6edf-4122-a6a6-8c9eb76273bd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:00.601937 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bb54fab-6edf-4122-a6a6-8c9eb76273bd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:00.602282 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bb54fab-6edf-4122-a6a6-8c9eb76273bd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:00.602698 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bb54fab-6edf-4122-a6a6-8c9eb76273bd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:00.629420 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:00.630068 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:00.640104 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:00.650318 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:00.650781 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:00.651558 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:00.652151 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:00.652496 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:00.906543 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3bb54fab-6edf-4122-a6a6-8c9eb76273bd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:00.916820 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3bb54fab-6edf-4122-a6a6-8c9eb76273bd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.340879 Sep 18 00:57:00.917641 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 58/121] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:00 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:00.934524 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:00.946571 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:00.948064 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:00.949834 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-73d0d21b-e5a0-4825-9adb-16395f9f4942 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1406 microversion: 2.20 time: 0.324407 Sep 18 00:57:00.950552 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 64/122] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:57:00 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:57:01.214639 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1dea2811-fc77-4dc9-adbf-617b7c0f8db2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:01.215632 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1dea2811-fc77-4dc9-adbf-617b7c0f8db2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:01.222747 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1dea2811-fc77-4dc9-adbf-617b7c0f8db2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:01.224727 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1dea2811-fc77-4dc9-adbf-617b7c0f8db2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:01.225480 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1dea2811-fc77-4dc9-adbf-617b7c0f8db2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:01.226415 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1dea2811-fc77-4dc9-adbf-617b7c0f8db2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:01.227216 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1dea2811-fc77-4dc9-adbf-617b7c0f8db2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:01.227644 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1dea2811-fc77-4dc9-adbf-617b7c0f8db2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:01.232303 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-caf85583-9aff-49e0-80f0-02a71e0fdd77 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:01.233007 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-caf85583-9aff-49e0-80f0-02a71e0fdd77 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:01.239350 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-caf85583-9aff-49e0-80f0-02a71e0fdd77 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:01.240040 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-caf85583-9aff-49e0-80f0-02a71e0fdd77 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:01.240661 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-caf85583-9aff-49e0-80f0-02a71e0fdd77 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:01.241741 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-caf85583-9aff-49e0-80f0-02a71e0fdd77 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:01.242348 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-caf85583-9aff-49e0-80f0-02a71e0fdd77 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:01.243354 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-caf85583-9aff-49e0-80f0-02a71e0fdd77 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:01.268805 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:01.453192 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1dea2811-fc77-4dc9-adbf-617b7c0f8db2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:01.462957 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1dea2811-fc77-4dc9-adbf-617b7c0f8db2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1553 microversion: 2.1 time: 0.252007 Sep 18 00:57:01.463671 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 59/123] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:01 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:01.483158 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-caf85583-9aff-49e0-80f0-02a71e0fdd77 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:01.499660 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-caf85583-9aff-49e0-80f0-02a71e0fdd77 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.271602 Sep 18 00:57:01.500476 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 65/124] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:01 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:01.942127 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3445772b-0d6c-4d4e-a836-2caca31920b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:01.943068 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3445772b-0d6c-4d4e-a836-2caca31920b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:01.950748 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3445772b-0d6c-4d4e-a836-2caca31920b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:01.951377 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3445772b-0d6c-4d4e-a836-2caca31920b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:01.952033 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3445772b-0d6c-4d4e-a836-2caca31920b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:01.952746 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3445772b-0d6c-4d4e-a836-2caca31920b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:01.954105 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3445772b-0d6c-4d4e-a836-2caca31920b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:01.954711 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3445772b-0d6c-4d4e-a836-2caca31920b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:01.977702 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:01.980250 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:01.992750 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:01.993271 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:01.993708 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:01.994509 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:01.995133 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:01.995564 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:02.269031 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:02.279436 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:02.281505 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:02.282844 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9ac4e23b-46d5-4ae5-ab8e-b9d904240603 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1599 microversion: 2.20 time: 0.311100 Sep 18 00:57:02.283685 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 66/125] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:57:01 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1599 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:57:02.309948 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f71c4c8b-18b7-4825-b237-ada4a292427a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:02.310885 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f71c4c8b-18b7-4825-b237-ada4a292427a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:02.318621 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f71c4c8b-18b7-4825-b237-ada4a292427a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:02.319264 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f71c4c8b-18b7-4825-b237-ada4a292427a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:02.320058 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f71c4c8b-18b7-4825-b237-ada4a292427a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:02.320878 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f71c4c8b-18b7-4825-b237-ada4a292427a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:02.321428 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f71c4c8b-18b7-4825-b237-ada4a292427a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:02.322061 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f71c4c8b-18b7-4825-b237-ada4a292427a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:02.385305 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3445772b-0d6c-4d4e-a836-2caca31920b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:02.398176 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3445772b-0d6c-4d4e-a836-2caca31920b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.459389 Sep 18 00:57:02.399167 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 60/126] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:01 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:02.456616 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f71c4c8b-18b7-4825-b237-ada4a292427a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.150921 Sep 18 00:57:02.458330 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 67/127] 10.222.0.33 () {60 vars in 1316 bytes} [Sun Sep 18 00:57:02 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 00:57:02.485638 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0abd2088-d997-45a3-8898-c6edd7670625 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:02.486244 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0abd2088-d997-45a3-8898-c6edd7670625 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:02.492292 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abd2088-d997-45a3-8898-c6edd7670625 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:02.492772 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abd2088-d997-45a3-8898-c6edd7670625 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:02.493198 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abd2088-d997-45a3-8898-c6edd7670625 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:02.493878 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abd2088-d997-45a3-8898-c6edd7670625 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:02.494323 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abd2088-d997-45a3-8898-c6edd7670625 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:02.494738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abd2088-d997-45a3-8898-c6edd7670625 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:02.526651 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-bd1b9e05-c5ec-4d5e-b539-7a704dbfa39e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:02.527292 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-bd1b9e05-c5ec-4d5e-b539-7a704dbfa39e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:02.533743 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd1b9e05-c5ec-4d5e-b539-7a704dbfa39e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:02.534325 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd1b9e05-c5ec-4d5e-b539-7a704dbfa39e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:02.534935 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd1b9e05-c5ec-4d5e-b539-7a704dbfa39e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:02.535801 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd1b9e05-c5ec-4d5e-b539-7a704dbfa39e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:02.536456 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd1b9e05-c5ec-4d5e-b539-7a704dbfa39e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:02.536887 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd1b9e05-c5ec-4d5e-b539-7a704dbfa39e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:03.266428 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0abd2088-d997-45a3-8898-c6edd7670625 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:03.283798 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0abd2088-d997-45a3-8898-c6edd7670625 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1553 microversion: 2.1 time: 0.795132 Sep 18 00:57:03.294817 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 61/128] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:02 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1553 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:03.294817 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-7abbdc67-0e5d-4cde-a273-0412e9ecbe9e req-ad7cc332-8064-48f5-93e3-2d980bbee8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5674ad19-62fd-4a3a-98b8-27051ad03cc7", "name": "network-vif-deleted", "tag": "a8ed2c0d-d075-4325-a1f8-6418484d4934"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:03.313275 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-7abbdc67-0e5d-4cde-a273-0412e9ecbe9e req-ad7cc332-8064-48f5-93e3-2d980bbee8d9 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:03.313889 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-7abbdc67-0e5d-4cde-a273-0412e9ecbe9e req-ad7cc332-8064-48f5-93e3-2d980bbee8d9 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:03.319334 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-7abbdc67-0e5d-4cde-a273-0412e9ecbe9e req-ad7cc332-8064-48f5-93e3-2d980bbee8d9 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:03.336712 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-7abbdc67-0e5d-4cde-a273-0412e9ecbe9e req-ad7cc332-8064-48f5-93e3-2d980bbee8d9 service nova] Creating event network-vif-deleted:a8ed2c0d-d075-4325-a1f8-6418484d4934 for instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 on hv-cinder-maste Sep 18 00:57:03.356624 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-7abbdc67-0e5d-4cde-a273-0412e9ecbe9e req-ad7cc332-8064-48f5-93e3-2d980bbee8d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069757 Sep 18 00:57:03.357344 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 62/129] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:57:03.408977 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-bd1b9e05-c5ec-4d5e-b539-7a704dbfa39e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:03.422265 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c1c08e16-bfce-4a3e-80a4-170bbb123e61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:03.423155 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c1c08e16-bfce-4a3e-80a4-170bbb123e61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:03.427346 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-bd1b9e05-c5ec-4d5e-b539-7a704dbfa39e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1365 microversion: 2.1 time: 0.901251 Sep 18 00:57:03.428374 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 68/130] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:02 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1365 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:03.447628 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1c08e16-bfce-4a3e-80a4-170bbb123e61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:03.448134 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1c08e16-bfce-4a3e-80a4-170bbb123e61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:03.448599 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1c08e16-bfce-4a3e-80a4-170bbb123e61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:03.449315 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1c08e16-bfce-4a3e-80a4-170bbb123e61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:03.449773 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1c08e16-bfce-4a3e-80a4-170bbb123e61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:03.450224 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1c08e16-bfce-4a3e-80a4-170bbb123e61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:03.463976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=100 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:04.033713 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c1c08e16-bfce-4a3e-80a4-170bbb123e61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:04.045636 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c1c08e16-bfce-4a3e-80a4-170bbb123e61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.627754 Sep 18 00:57:04.047460 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 63/131] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:03 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:04.311562 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:04.315585 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:04.338452 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:04.338997 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:04.339466 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:04.350398 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:04.350957 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:04.352577 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:04.441361 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:04.442111 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:04.442698 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:04.444322 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lazy-loading 'fault' on Instance uuid 5674ad19-62fd-4a3a-98b8-27051ad03cc7 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:57:04.458933 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c1670497-b2f9-4f81-889d-abed146abc9f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:04.459702 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c1670497-b2f9-4f81-889d-abed146abc9f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:04.468201 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1670497-b2f9-4f81-889d-abed146abc9f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:04.468774 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1670497-b2f9-4f81-889d-abed146abc9f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:04.476894 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1670497-b2f9-4f81-889d-abed146abc9f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:04.484944 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1670497-b2f9-4f81-889d-abed146abc9f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:04.485523 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1670497-b2f9-4f81-889d-abed146abc9f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:04.485997 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1670497-b2f9-4f81-889d-abed146abc9f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:04.538662 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:04.566732 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-91883ee2-9a91-4e89-9b55-3d1871a764c2 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1350 microversion: 2.1 time: 0.258258 Sep 18 00:57:04.568334 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 69/132] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:04 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1350 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:04.966581 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c1670497-b2f9-4f81-889d-abed146abc9f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:04.992383 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c1670497-b2f9-4f81-889d-abed146abc9f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1554 microversion: 2.1 time: 0.537909 Sep 18 00:57:04.993929 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 64/133] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:04 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1554 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:05.019988 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-64da9a64-6a59-4afd-ba0b-9de396d170ff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:05.020537 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-64da9a64-6a59-4afd-ba0b-9de396d170ff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:05.026592 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:05.028280 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64da9a64-6a59-4afd-ba0b-9de396d170ff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:05.029083 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64da9a64-6a59-4afd-ba0b-9de396d170ff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:05.029691 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64da9a64-6a59-4afd-ba0b-9de396d170ff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:05.030764 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64da9a64-6a59-4afd-ba0b-9de396d170ff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:05.031406 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64da9a64-6a59-4afd-ba0b-9de396d170ff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:05.031966 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64da9a64-6a59-4afd-ba0b-9de396d170ff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:05.072167 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-70f57419-a145-45b2-9ee3-b03ab478a844 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:05.072884 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-70f57419-a145-45b2-9ee3-b03ab478a844 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:05.079425 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-70f57419-a145-45b2-9ee3-b03ab478a844 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:05.083529 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-70f57419-a145-45b2-9ee3-b03ab478a844 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:05.085033 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-70f57419-a145-45b2-9ee3-b03ab478a844 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:05.091697 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-70f57419-a145-45b2-9ee3-b03ab478a844 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:05.092436 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-70f57419-a145-45b2-9ee3-b03ab478a844 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:05.093056 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-70f57419-a145-45b2-9ee3-b03ab478a844 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:05.438085 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-64da9a64-6a59-4afd-ba0b-9de396d170ff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.422536 Sep 18 00:57:05.438689 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 70/134] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 18 00:57:05 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-interface => generated 284 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:57:05.453066 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-4c22f4b3-64f5-4d29-b4f6-7e034fc502f6 req-934569c4-cbc5-4902-bbed-10652ef0fa22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1cf145a-d8d5-4a7e-937b-729bf79629fa", "tag": "3b10ed6a-bc95-40e6-afaa-4936e44594eb"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:05.469522 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-4c22f4b3-64f5-4d29-b4f6-7e034fc502f6 req-934569c4-cbc5-4902-bbed-10652ef0fa22 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:05.470208 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-4c22f4b3-64f5-4d29-b4f6-7e034fc502f6 req-934569c4-cbc5-4902-bbed-10652ef0fa22 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:05.471015 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-4c22f4b3-64f5-4d29-b4f6-7e034fc502f6 req-934569c4-cbc5-4902-bbed-10652ef0fa22 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:05.508358 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-4c22f4b3-64f5-4d29-b4f6-7e034fc502f6 req-934569c4-cbc5-4902-bbed-10652ef0fa22 service nova] Creating event network-changed:3b10ed6a-bc95-40e6-afaa-4936e44594eb for instance c1cf145a-d8d5-4a7e-937b-729bf79629fa on hv-cinder-maste Sep 18 00:57:05.524482 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-4c22f4b3-64f5-4d29-b4f6-7e034fc502f6 req-934569c4-cbc5-4902-bbed-10652ef0fa22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075898 Sep 18 00:57:05.525132 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 71/135] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:57:05.595558 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:05.596257 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:05.608572 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-70f57419-a145-45b2-9ee3-b03ab478a844 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:05.610868 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:05.615312 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:05.615773 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:05.616500 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:05.620630 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:05.621417 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:05.629936 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-70f57419-a145-45b2-9ee3-b03ab478a844 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.553031 Sep 18 00:57:05.631200 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 65/136] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:05 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:05.736250 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:05.736343 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:05.736746 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:05.737205 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lazy-loading 'fault' on Instance uuid 5674ad19-62fd-4a3a-98b8-27051ad03cc7 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:57:06.011375 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a703706c16c4ff3a07c37ba65d26778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e0132d9e0c47b9b4c2042dba767701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:06.021113 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-65b21ff3-2bf4-4d47-9513-64118532e8b5 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 200 len: 1304 microversion: 2.1 time: 0.433720 Sep 18 00:57:06.024567 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 72/137] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:05 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 1304 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:06.657920 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-915e0c0a-bfda-4776-a6b4-1da2c4f8a334 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:06.659732 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-915e0c0a-bfda-4776-a6b4-1da2c4f8a334 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:06.677539 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-915e0c0a-bfda-4776-a6b4-1da2c4f8a334 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:06.678400 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-915e0c0a-bfda-4776-a6b4-1da2c4f8a334 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:06.679251 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-915e0c0a-bfda-4776-a6b4-1da2c4f8a334 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:06.682566 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-915e0c0a-bfda-4776-a6b4-1da2c4f8a334 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:06.683306 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-915e0c0a-bfda-4776-a6b4-1da2c4f8a334 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:06.683805 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-915e0c0a-bfda-4776-a6b4-1da2c4f8a334 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:07.047728 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:07.048457 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:07.055753 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:07.056242 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:07.056681 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:07.057387 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:07.057940 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:07.058375 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:07.072320 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] HTTP exception thrown: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Request method failure captured: Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 HTTP/1.1 Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmy1EMyBZyTHKiBefg4HX_pTSdpHKVPlK4di8HluEmfKeF_HuBYtRpvpwCwhqXzyXkgk-5IbyL4GkVaoCi25BFRMryQpJCSfm-VoU9jBRnYyEU-727M-nk9IJah1WBI0nuKSKAurw1ClwpqAMrtkmqbHDxnnBGh8pNTF543CZefKXNk Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: d8e0132d9e0c47b9b4c2042dba767701 Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:57:07.076898 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8e0132d9e0c47b9b4c2042dba767701"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8e0132d9e0c47b9b4c2042dba767701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8e0132d9e0c47b9b4c2042dba767701", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8e0132d9e0c47b9b4c2042dba767701"}]}] Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: d8e0132d9e0c47b9b4c2042dba767701 Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-DeleteServersTestJSON-1695902054-project Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 2a703706c16c4ff3a07c37ba65d26778 Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-DeleteServersTestJSON-1695902054-project Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:07.078214 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '5674ad19-62fd-4a3a-98b8-27051ad03cc7'} Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:57:07.082421 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:07.083855 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:07.085055 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Returning 404 to user: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:57:07.085055 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-873eca6c-12e3-47cd-b582-1ba1e8315d24 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 404 len: 111 microversion: 2.1 time: 0.034563 Sep 18 00:57:07.085055 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 73/138] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:07 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 00:57:07.090358 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-915e0c0a-bfda-4776-a6b4-1da2c4f8a334 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:07.105603 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-915e0c0a-bfda-4776-a6b4-1da2c4f8a334 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.454854 Sep 18 00:57:07.106679 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 66/139] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:06 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:07.259374 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:07.262090 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:07.268141 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:07.268865 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:07.269448 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:07.270257 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:07.271013 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:07.271538 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:07.286326 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] HTTP exception thrown: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Request method failure captured: Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7/os-volume_attachments HTTP/1.1 Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmy1EMyBZyTHKiBefg4HX_pTSdpHKVPlK4di8HluEmfKeF_HuBYtRpvpwCwhqXzyXkgk-5IbyL4GkVaoCi25BFRMryQpJCSfm-VoU9jBRnYyEU-727M-nk9IJah1WBI0nuKSKAurw1ClwpqAMrtkmqbHDxnnBGh8pNTF543CZefKXNk Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: d8e0132d9e0c47b9b4c2042dba767701 Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:57:07.288067 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8e0132d9e0c47b9b4c2042dba767701"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8e0132d9e0c47b9b4c2042dba767701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8e0132d9e0c47b9b4c2042dba767701", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8e0132d9e0c47b9b4c2042dba767701"}]}] Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: d8e0132d9e0c47b9b4c2042dba767701 Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-DeleteServersTestJSON-1695902054-project Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 2a703706c16c4ff3a07c37ba65d26778 Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-DeleteServersTestJSON-1695902054-project Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:07.289499 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'server_id': '5674ad19-62fd-4a3a-98b8-27051ad03cc7'} Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:57:07.290407 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:07.291873 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:07.293110 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Returning 404 to user: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:57:07.294201 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f2effef9-0be9-4de2-ae2a-76b95ba1ab32 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039996 Sep 18 00:57:07.294894 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 74/140] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 00:57:07 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 00:57:07.580131 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-edc4dd4f-9779-46ec-9cf1-1e49a3cde792 req-d220473e-2ce1-4ac0-93b4-26c294e7f460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2055882-050f-4acf-a99c-96d698e25963", "tag": "ff818f99-6875-42e7-8af0-6e7c1e9ef011"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:07.591027 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-edc4dd4f-9779-46ec-9cf1-1e49a3cde792 req-d220473e-2ce1-4ac0-93b4-26c294e7f460 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:07.591507 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-edc4dd4f-9779-46ec-9cf1-1e49a3cde792 req-d220473e-2ce1-4ac0-93b4-26c294e7f460 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:07.591950 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-edc4dd4f-9779-46ec-9cf1-1e49a3cde792 req-d220473e-2ce1-4ac0-93b4-26c294e7f460 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:07.605188 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-edc4dd4f-9779-46ec-9cf1-1e49a3cde792 req-d220473e-2ce1-4ac0-93b4-26c294e7f460 service nova] Creating event network-changed:ff818f99-6875-42e7-8af0-6e7c1e9ef011 for instance e2055882-050f-4acf-a99c-96d698e25963 on hv-cinder-maste Sep 18 00:57:07.610294 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-edc4dd4f-9779-46ec-9cf1-1e49a3cde792 req-d220473e-2ce1-4ac0-93b4-26c294e7f460 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033763 Sep 18 00:57:07.610983 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 67/141] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:57:08.130272 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-544f15db-3497-4e1c-943a-107f07bf2dd5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:08.131174 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-544f15db-3497-4e1c-943a-107f07bf2dd5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:08.139738 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-544f15db-3497-4e1c-943a-107f07bf2dd5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:08.140233 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-544f15db-3497-4e1c-943a-107f07bf2dd5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:08.140697 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-544f15db-3497-4e1c-943a-107f07bf2dd5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:08.141388 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-544f15db-3497-4e1c-943a-107f07bf2dd5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:08.141851 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-544f15db-3497-4e1c-943a-107f07bf2dd5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:08.142279 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-544f15db-3497-4e1c-943a-107f07bf2dd5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:08.336887 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-544f15db-3497-4e1c-943a-107f07bf2dd5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:08.345169 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-544f15db-3497-4e1c-943a-107f07bf2dd5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.219506 Sep 18 00:57:08.345959 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 75/142] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:08 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:08.527796 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:08.528385 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:08.535985 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:08.536503 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:08.536965 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:08.537671 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:08.538136 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:08.538563 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:08.553734 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] HTTP exception thrown: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Request method failure captured: Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: DELETE /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 HTTP/1.1 Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy1EMyBZyTHKiBefg4HX_pTSdpHKVPlK4di8HluEmfKeF_HuBYtRpvpwCwhqXzyXkgk-5IbyL4GkVaoCi25BFRMryQpJCSfm-VoU9jBRnYyEU-727M-nk9IJah1WBI0nuKSKAurw1ClwpqAMrtkmqbHDxnnBGh8pNTF543CZefKXNk Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: d8e0132d9e0c47b9b4c2042dba767701 Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 00:57:08.558570 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8e0132d9e0c47b9b4c2042dba767701"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8e0132d9e0c47b9b4c2042dba767701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8e0132d9e0c47b9b4c2042dba767701", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8e0132d9e0c47b9b4c2042dba767701"}]}] Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: d8e0132d9e0c47b9b4c2042dba767701 Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-DeleteServersTestJSON-1695902054-project Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 2a703706c16c4ff3a07c37ba65d26778 Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-DeleteServersTestJSON-1695902054-project Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:08.560019 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '5674ad19-62fd-4a3a-98b8-27051ad03cc7'} Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:57:08.560774 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:08.561986 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:57:08.563146 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Returning 404 to user: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:57:08.563146 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7aa99331-38d1-4617-b279-b5f8318f696c tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 404 len: 111 microversion: 2.1 time: 0.037070 Sep 18 00:57:08.563146 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 68/143] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 00:57:08 2022] DELETE /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 00:57:08.570172 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:08.570611 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] [instance: 5674ad19-62fd-4a3a-98b8-27051ad03cc7] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:08.577052 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:08.577547 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:08.578015 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:08.578731 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:08.579211 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:08.579635 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:08.596625 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] HTTP exception thrown: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Request method failure captured: Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 HTTP/1.1 Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmy1EMyBZyTHKiBefg4HX_pTSdpHKVPlK4di8HluEmfKeF_HuBYtRpvpwCwhqXzyXkgk-5IbyL4GkVaoCi25BFRMryQpJCSfm-VoU9jBRnYyEU-727M-nk9IJah1WBI0nuKSKAurw1ClwpqAMrtkmqbHDxnnBGh8pNTF543CZefKXNk Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: d8e0132d9e0c47b9b4c2042dba767701 Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:57:08.598258 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d8e0132d9e0c47b9b4c2042dba767701"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8e0132d9e0c47b9b4c2042dba767701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d8e0132d9e0c47b9b4c2042dba767701", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d8e0132d9e0c47b9b4c2042dba767701"}]}] Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: d8e0132d9e0c47b9b4c2042dba767701 Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-DeleteServersTestJSON-1695902054 Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-DeleteServersTestJSON-1695902054-project Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 2a703706c16c4ff3a07c37ba65d26778 Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-DeleteServersTestJSON-1695902054-project Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:08.599804 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '5674ad19-62fd-4a3a-98b8-27051ad03cc7'} Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:57:08.600551 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. Sep 18 00:57:08.601626 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:08.602699 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] Returning 404 to user: Instance 5674ad19-62fd-4a3a-98b8-27051ad03cc7 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:57:08.602699 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-324e9a03-d27d-4c51-9ddd-870956cdf375 tempest-DeleteServersTestJSON-1695902054 tempest-DeleteServersTestJSON-1695902054-project] 10.222.0.33 "GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7" status: 404 len: 111 microversion: 2.1 time: 0.034551 Sep 18 00:57:08.602699 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 76/144] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:08 2022] GET /compute/v2.1/servers/5674ad19-62fd-4a3a-98b8-27051ad03cc7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 00:57:09.147106 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1540141165", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "networks": [{"uuid": "7aa7dca7-9cff-4b1a-8ea5-d2e6639d53b6"}]}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:09.230883 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] validate_networks() for [('7aa7dca7-9cff-4b1a-8ea5-d2e6639d53b6', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:57:09.369278 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-056e213c-d8ab-42fb-9e5c-a4da91e122b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:09.370659 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-056e213c-d8ab-42fb-9e5c-a4da91e122b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:09.377450 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-056e213c-d8ab-42fb-9e5c-a4da91e122b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:09.378078 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-056e213c-d8ab-42fb-9e5c-a4da91e122b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:09.379386 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-056e213c-d8ab-42fb-9e5c-a4da91e122b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:09.380376 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-056e213c-d8ab-42fb-9e5c-a4da91e122b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:09.381584 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-056e213c-d8ab-42fb-9e5c-a4da91e122b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:09.382091 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-056e213c-d8ab-42fb-9e5c-a4da91e122b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:09.770207 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-056e213c-d8ab-42fb-9e5c-a4da91e122b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:09.781341 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-056e213c-d8ab-42fb-9e5c-a4da91e122b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.416020 Sep 18 00:57:09.782190 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 77/145] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:09 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:09.988640 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:57:09.989097 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:57:09.989525 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:57:09.989935 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:57:09.990346 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:57:09.999242 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:09.999718 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:10.000155 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:10.000881 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:10.001333 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:10.001757 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:10.019827 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Getting quotas for project 4760ac3b2a024eb7a0718a1420d492a9. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:57:10.023846 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Getting quotas for user c083eff39e644588b8516dabbfbb719f and project 4760ac3b2a024eb7a0718a1420d492a9. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:57:10.034816 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:57:10.037126 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:57:10.085801 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-082cc290-172e-4a8a-8f38-5fb1d0168cc4 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942916 Sep 18 00:57:10.086776 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 69/146] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:57:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:57:10.098264 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2d483cb5-55aa-4044-a22e-854ca1d58af2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:10.098904 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-2d483cb5-55aa-4044-a22e-854ca1d58af2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:10.177784 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2d483cb5-55aa-4044-a22e-854ca1d58af2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:10.185755 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2d483cb5-55aa-4044-a22e-854ca1d58af2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1214 microversion: 2.1 time: 0.091896 Sep 18 00:57:10.186537 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 78/147] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:10 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:10.807817 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f779d864-0f2f-4b29-8aa7-32de2f04e436 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:10.808449 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f779d864-0f2f-4b29-8aa7-32de2f04e436 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:10.817177 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f779d864-0f2f-4b29-8aa7-32de2f04e436 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:10.818016 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f779d864-0f2f-4b29-8aa7-32de2f04e436 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:10.818782 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f779d864-0f2f-4b29-8aa7-32de2f04e436 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:10.820617 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f779d864-0f2f-4b29-8aa7-32de2f04e436 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:10.821387 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f779d864-0f2f-4b29-8aa7-32de2f04e436 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:10.822718 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f779d864-0f2f-4b29-8aa7-32de2f04e436 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:11.048052 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f779d864-0f2f-4b29-8aa7-32de2f04e436 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:11.063982 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f779d864-0f2f-4b29-8aa7-32de2f04e436 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.260399 Sep 18 00:57:11.064718 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 70/148] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:10 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:11.214138 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-964e62f4-1ab7-4c3e-922a-7c88e13ffaf6 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:11.215596 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-964e62f4-1ab7-4c3e-922a-7c88e13ffaf6 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:11.227226 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-964e62f4-1ab7-4c3e-922a-7c88e13ffaf6 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:11.228877 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-964e62f4-1ab7-4c3e-922a-7c88e13ffaf6 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:11.229619 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-964e62f4-1ab7-4c3e-922a-7c88e13ffaf6 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:11.231380 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-964e62f4-1ab7-4c3e-922a-7c88e13ffaf6 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:11.232598 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-964e62f4-1ab7-4c3e-922a-7c88e13ffaf6 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:11.234512 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-964e62f4-1ab7-4c3e-922a-7c88e13ffaf6 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:11.312802 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-964e62f4-1ab7-4c3e-922a-7c88e13ffaf6 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:11.322992 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-964e62f4-1ab7-4c3e-922a-7c88e13ffaf6 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1266 microversion: 2.1 time: 0.112548 Sep 18 00:57:11.323780 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 79/149] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:11 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:12.088794 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-62e112dd-398b-4a6b-9a13-a713d469cc04 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:12.089938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-62e112dd-398b-4a6b-9a13-a713d469cc04 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:12.098899 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62e112dd-398b-4a6b-9a13-a713d469cc04 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:12.099747 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62e112dd-398b-4a6b-9a13-a713d469cc04 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:12.100377 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62e112dd-398b-4a6b-9a13-a713d469cc04 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:12.103336 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62e112dd-398b-4a6b-9a13-a713d469cc04 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:12.103903 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62e112dd-398b-4a6b-9a13-a713d469cc04 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:12.104423 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62e112dd-398b-4a6b-9a13-a713d469cc04 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:12.312896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-62e112dd-398b-4a6b-9a13-a713d469cc04 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:12.330203 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-62e112dd-398b-4a6b-9a13-a713d469cc04 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.243506 Sep 18 00:57:12.332373 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 71/150] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:12 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:12.353900 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-34cfc8f8-b161-4402-87e1-da6799e0582a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:12.354418 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-34cfc8f8-b161-4402-87e1-da6799e0582a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:12.361023 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34cfc8f8-b161-4402-87e1-da6799e0582a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:12.361525 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34cfc8f8-b161-4402-87e1-da6799e0582a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:12.361964 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34cfc8f8-b161-4402-87e1-da6799e0582a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:12.363234 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34cfc8f8-b161-4402-87e1-da6799e0582a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:12.363704 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34cfc8f8-b161-4402-87e1-da6799e0582a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:12.364133 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34cfc8f8-b161-4402-87e1-da6799e0582a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:12.446636 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-34cfc8f8-b161-4402-87e1-da6799e0582a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:12.462244 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-34cfc8f8-b161-4402-87e1-da6799e0582a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1272 microversion: 2.1 time: 0.113965 Sep 18 00:57:12.463167 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 80/151] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:12 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1272 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:13.354366 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4dc2af2d-ca23-40b7-91e8-21556c5fda28 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:13.354938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4dc2af2d-ca23-40b7-91e8-21556c5fda28 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:13.361403 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dc2af2d-ca23-40b7-91e8-21556c5fda28 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:13.361896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dc2af2d-ca23-40b7-91e8-21556c5fda28 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:13.362334 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dc2af2d-ca23-40b7-91e8-21556c5fda28 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:13.363626 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dc2af2d-ca23-40b7-91e8-21556c5fda28 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:13.364271 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dc2af2d-ca23-40b7-91e8-21556c5fda28 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:13.364856 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dc2af2d-ca23-40b7-91e8-21556c5fda28 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:13.490879 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f3cd2285-46b5-44bc-bec2-4bfced95129b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:13.492340 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f3cd2285-46b5-44bc-bec2-4bfced95129b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:13.501447 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3cd2285-46b5-44bc-bec2-4bfced95129b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:13.510010 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3cd2285-46b5-44bc-bec2-4bfced95129b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:13.510010 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3cd2285-46b5-44bc-bec2-4bfced95129b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:13.510010 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3cd2285-46b5-44bc-bec2-4bfced95129b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:13.510010 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3cd2285-46b5-44bc-bec2-4bfced95129b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:13.510455 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3cd2285-46b5-44bc-bec2-4bfced95129b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:13.719199 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4dc2af2d-ca23-40b7-91e8-21556c5fda28 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:13.732317 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4dc2af2d-ca23-40b7-91e8-21556c5fda28 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.382249 Sep 18 00:57:13.732910 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 72/152] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:13 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:13.835216 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f3cd2285-46b5-44bc-bec2-4bfced95129b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:13.846202 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f3cd2285-46b5-44bc-bec2-4bfced95129b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1314 microversion: 2.1 time: 0.360527 Sep 18 00:57:13.862580 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 81/153] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:13 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:14.354625 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-08c4b48c-e42e-44cd-868e-6e968b2e8253 req-a75586a4-2cb5-4ec4-9fbd-5526ebcd3682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a299b3f6-a499-46c6-82f8-6cdefdb3bdab", "tag": "6bf76ae4-15b2-4029-910e-ffa2a8b17d63"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:14.369527 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-08c4b48c-e42e-44cd-868e-6e968b2e8253 req-a75586a4-2cb5-4ec4-9fbd-5526ebcd3682 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:14.371560 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-08c4b48c-e42e-44cd-868e-6e968b2e8253 req-a75586a4-2cb5-4ec4-9fbd-5526ebcd3682 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:14.372763 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-08c4b48c-e42e-44cd-868e-6e968b2e8253 req-a75586a4-2cb5-4ec4-9fbd-5526ebcd3682 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:14.388353 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-08c4b48c-e42e-44cd-868e-6e968b2e8253 req-a75586a4-2cb5-4ec4-9fbd-5526ebcd3682 service nova] Creating event network-changed:6bf76ae4-15b2-4029-910e-ffa2a8b17d63 for instance a299b3f6-a499-46c6-82f8-6cdefdb3bdab on hv-cinder-maste Sep 18 00:57:14.394463 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-08c4b48c-e42e-44cd-868e-6e968b2e8253 req-a75586a4-2cb5-4ec4-9fbd-5526ebcd3682 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044042 Sep 18 00:57:14.395199 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 73/154] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:57:14.756739 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-07068e00-5d6f-4900-998c-28f32ff51e92 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:14.757394 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-07068e00-5d6f-4900-998c-28f32ff51e92 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:14.769549 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-07068e00-5d6f-4900-998c-28f32ff51e92 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:14.771840 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-07068e00-5d6f-4900-998c-28f32ff51e92 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:14.772300 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-07068e00-5d6f-4900-998c-28f32ff51e92 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:14.773027 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-07068e00-5d6f-4900-998c-28f32ff51e92 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:14.773488 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-07068e00-5d6f-4900-998c-28f32ff51e92 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:14.773913 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-07068e00-5d6f-4900-998c-28f32ff51e92 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:14.870589 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-063e7a35-34c6-490f-b816-4c07c8e5d046 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:14.871396 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-063e7a35-34c6-490f-b816-4c07c8e5d046 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:14.877817 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-063e7a35-34c6-490f-b816-4c07c8e5d046 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:14.880469 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-063e7a35-34c6-490f-b816-4c07c8e5d046 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:14.882255 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-063e7a35-34c6-490f-b816-4c07c8e5d046 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:14.884001 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-063e7a35-34c6-490f-b816-4c07c8e5d046 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:14.884690 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-063e7a35-34c6-490f-b816-4c07c8e5d046 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:14.885384 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-063e7a35-34c6-490f-b816-4c07c8e5d046 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:15.038251 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-07068e00-5d6f-4900-998c-28f32ff51e92 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:15.051996 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-07068e00-5d6f-4900-998c-28f32ff51e92 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.299906 Sep 18 00:57:15.052913 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 82/155] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:14 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:15.121291 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-063e7a35-34c6-490f-b816-4c07c8e5d046 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:15.140047 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-063e7a35-34c6-490f-b816-4c07c8e5d046 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1314 microversion: 2.1 time: 0.273550 Sep 18 00:57:15.142002 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 74/156] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:14 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:16.074607 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1b71f06d-6447-4750-8dc9-e4d1ce93f107 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:16.075278 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-1b71f06d-6447-4750-8dc9-e4d1ce93f107 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:16.082034 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1b71f06d-6447-4750-8dc9-e4d1ce93f107 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:16.082521 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1b71f06d-6447-4750-8dc9-e4d1ce93f107 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:16.082984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1b71f06d-6447-4750-8dc9-e4d1ce93f107 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:16.083674 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1b71f06d-6447-4750-8dc9-e4d1ce93f107 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:16.084127 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1b71f06d-6447-4750-8dc9-e4d1ce93f107 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:16.084548 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1b71f06d-6447-4750-8dc9-e4d1ce93f107 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:16.164276 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a30d180c-3e68-45c9-a49c-9251220a2d6e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:16.164885 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a30d180c-3e68-45c9-a49c-9251220a2d6e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:16.170997 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30d180c-3e68-45c9-a49c-9251220a2d6e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:16.171485 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30d180c-3e68-45c9-a49c-9251220a2d6e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:16.171915 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30d180c-3e68-45c9-a49c-9251220a2d6e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:16.172658 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30d180c-3e68-45c9-a49c-9251220a2d6e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:16.173168 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30d180c-3e68-45c9-a49c-9251220a2d6e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:16.173596 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30d180c-3e68-45c9-a49c-9251220a2d6e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:16.254713 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-1b71f06d-6447-4750-8dc9-e4d1ce93f107 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:16.265066 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-1b71f06d-6447-4750-8dc9-e4d1ce93f107 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.194050 Sep 18 00:57:16.266231 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 83/157] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:16 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:16.325792 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a30d180c-3e68-45c9-a49c-9251220a2d6e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:16.340859 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a30d180c-3e68-45c9-a49c-9251220a2d6e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1314 microversion: 2.1 time: 0.180452 Sep 18 00:57:16.341428 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 75/158] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:16 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:17.290464 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1f37ab28-fda8-4fd3-b24b-4088f4c8ca70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:17.291187 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-1f37ab28-fda8-4fd3-b24b-4088f4c8ca70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:17.298132 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1f37ab28-fda8-4fd3-b24b-4088f4c8ca70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:17.299757 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1f37ab28-fda8-4fd3-b24b-4088f4c8ca70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:17.300321 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1f37ab28-fda8-4fd3-b24b-4088f4c8ca70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:17.301153 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1f37ab28-fda8-4fd3-b24b-4088f4c8ca70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:17.301712 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1f37ab28-fda8-4fd3-b24b-4088f4c8ca70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:17.302320 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1f37ab28-fda8-4fd3-b24b-4088f4c8ca70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:17.371100 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b0d07081-b480-43a6-b290-cbce320db6a8 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:17.372801 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b0d07081-b480-43a6-b290-cbce320db6a8 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:17.382273 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0d07081-b480-43a6-b290-cbce320db6a8 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:17.383041 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0d07081-b480-43a6-b290-cbce320db6a8 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:17.383482 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0d07081-b480-43a6-b290-cbce320db6a8 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:17.384185 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0d07081-b480-43a6-b290-cbce320db6a8 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:17.384641 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0d07081-b480-43a6-b290-cbce320db6a8 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:17.385238 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0d07081-b480-43a6-b290-cbce320db6a8 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:17.532090 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-1f37ab28-fda8-4fd3-b24b-4088f4c8ca70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:17.541082 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-1f37ab28-fda8-4fd3-b24b-4088f4c8ca70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.254586 Sep 18 00:57:17.542264 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 84/159] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:17 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:17.591200 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b0d07081-b480-43a6-b290-cbce320db6a8 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:17.601197 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b0d07081-b480-43a6-b290-cbce320db6a8 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1314 microversion: 2.1 time: 0.236888 Sep 18 00:57:17.615100 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 76/160] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:17 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:18.567161 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3641f9bd-8536-41c1-8499-9ddba9fd4f4e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:18.568309 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3641f9bd-8536-41c1-8499-9ddba9fd4f4e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:18.581858 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3641f9bd-8536-41c1-8499-9ddba9fd4f4e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:18.596281 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3641f9bd-8536-41c1-8499-9ddba9fd4f4e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:18.597692 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3641f9bd-8536-41c1-8499-9ddba9fd4f4e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:18.598333 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3641f9bd-8536-41c1-8499-9ddba9fd4f4e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:18.605384 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3641f9bd-8536-41c1-8499-9ddba9fd4f4e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:18.605861 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3641f9bd-8536-41c1-8499-9ddba9fd4f4e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:18.625568 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7781eb99-0cea-41e4-b777-f8f5f14e767f tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:18.626288 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7781eb99-0cea-41e4-b777-f8f5f14e767f tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:18.636144 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7781eb99-0cea-41e4-b777-f8f5f14e767f tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:18.636725 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7781eb99-0cea-41e4-b777-f8f5f14e767f tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:18.637262 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7781eb99-0cea-41e4-b777-f8f5f14e767f tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:18.637973 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7781eb99-0cea-41e4-b777-f8f5f14e767f tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:18.638569 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7781eb99-0cea-41e4-b777-f8f5f14e767f tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:18.642226 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7781eb99-0cea-41e4-b777-f8f5f14e767f tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:18.928497 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7781eb99-0cea-41e4-b777-f8f5f14e767f tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:18.930039 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3641f9bd-8536-41c1-8499-9ddba9fd4f4e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:18.933717 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=100 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:18.940778 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7781eb99-0cea-41e4-b777-f8f5f14e767f tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1314 microversion: 2.1 time: 0.317621 Sep 18 00:57:18.941002 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3641f9bd-8536-41c1-8499-9ddba9fd4f4e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.378745 Sep 18 00:57:18.942264 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 77/161] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:18 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:18.955474 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 85/162] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:18 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:19.966468 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-046733ea-34b7-48c5-9b41-3610bcf9160b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:19.967144 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-046733ea-34b7-48c5-9b41-3610bcf9160b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:19.976322 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-046733ea-34b7-48c5-9b41-3610bcf9160b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:19.977025 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-046733ea-34b7-48c5-9b41-3610bcf9160b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:19.977712 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d3f1f104-cb28-4ca6-92ea-c1f87c4c3493 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:19.978289 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-046733ea-34b7-48c5-9b41-3610bcf9160b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:19.978408 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d3f1f104-cb28-4ca6-92ea-c1f87c4c3493 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:19.980016 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-046733ea-34b7-48c5-9b41-3610bcf9160b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:19.980689 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-046733ea-34b7-48c5-9b41-3610bcf9160b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:19.981334 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-046733ea-34b7-48c5-9b41-3610bcf9160b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:19.988223 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d3f1f104-cb28-4ca6-92ea-c1f87c4c3493 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:19.988734 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d3f1f104-cb28-4ca6-92ea-c1f87c4c3493 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:19.989159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d3f1f104-cb28-4ca6-92ea-c1f87c4c3493 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:19.992467 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d3f1f104-cb28-4ca6-92ea-c1f87c4c3493 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:19.992996 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d3f1f104-cb28-4ca6-92ea-c1f87c4c3493 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:19.993380 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d3f1f104-cb28-4ca6-92ea-c1f87c4c3493 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:20.030121 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:20.040852 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=6 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:20.183409 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:20.231040 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-046733ea-34b7-48c5-9b41-3610bcf9160b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:20.242074 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-046733ea-34b7-48c5-9b41-3610bcf9160b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.279849 Sep 18 00:57:20.250839 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d3f1f104-cb28-4ca6-92ea-c1f87c4c3493 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:20.257657 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d3f1f104-cb28-4ca6-92ea-c1f87c4c3493 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1314 microversion: 2.1 time: 0.297267 Sep 18 00:57:20.258051 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 86/163] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:19 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:20.258564 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 78/164] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:19 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:20.266867 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-ba5787d1-a13f-4c8d-9686-ba21c648e302 req-77182425-7f20-4814-ba86-5c7345525bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a299b3f6-a499-46c6-82f8-6cdefdb3bdab", "name": "network-vif-plugged", "status": "completed", "tag": "6bf76ae4-15b2-4029-910e-ffa2a8b17d63"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:20.273007 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-ba5787d1-a13f-4c8d-9686-ba21c648e302 req-77182425-7f20-4814-ba86-5c7345525bff service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:20.273492 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-ba5787d1-a13f-4c8d-9686-ba21c648e302 req-77182425-7f20-4814-ba86-5c7345525bff service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:20.273915 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-ba5787d1-a13f-4c8d-9686-ba21c648e302 req-77182425-7f20-4814-ba86-5c7345525bff service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:20.287790 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-ba5787d1-a13f-4c8d-9686-ba21c648e302 req-77182425-7f20-4814-ba86-5c7345525bff service nova] Creating event network-vif-plugged:6bf76ae4-15b2-4029-910e-ffa2a8b17d63 for instance a299b3f6-a499-46c6-82f8-6cdefdb3bdab on hv-cinder-maste Sep 18 00:57:20.293105 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-ba5787d1-a13f-4c8d-9686-ba21c648e302 req-77182425-7f20-4814-ba86-5c7345525bff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033848 Sep 18 00:57:20.293694 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 87/165] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:57:21.264541 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-ebd3403c-2603-42e4-be1f-c05902e36277 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:21.265244 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-ebd3403c-2603-42e4-be1f-c05902e36277 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:21.272525 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ebd3403c-2603-42e4-be1f-c05902e36277 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:21.273052 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ebd3403c-2603-42e4-be1f-c05902e36277 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:21.273517 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ebd3403c-2603-42e4-be1f-c05902e36277 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:21.274251 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ebd3403c-2603-42e4-be1f-c05902e36277 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:21.274765 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ebd3403c-2603-42e4-be1f-c05902e36277 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:21.275215 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ebd3403c-2603-42e4-be1f-c05902e36277 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:21.288215 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-5a1dcef9-4f8b-4907-864f-9dfedc36c282 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:21.289032 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-5a1dcef9-4f8b-4907-864f-9dfedc36c282 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:21.297617 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a1dcef9-4f8b-4907-864f-9dfedc36c282 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:21.298198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a1dcef9-4f8b-4907-864f-9dfedc36c282 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:21.298643 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a1dcef9-4f8b-4907-864f-9dfedc36c282 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:21.299441 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a1dcef9-4f8b-4907-864f-9dfedc36c282 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:21.300447 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a1dcef9-4f8b-4907-864f-9dfedc36c282 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:21.301409 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a1dcef9-4f8b-4907-864f-9dfedc36c282 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:21.488187 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ebd3403c-2603-42e4-be1f-c05902e36277 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:21.491163 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-5a1dcef9-4f8b-4907-864f-9dfedc36c282 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:21.496957 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-ebd3403c-2603-42e4-be1f-c05902e36277 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.236347 Sep 18 00:57:21.509261 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-5a1dcef9-4f8b-4907-864f-9dfedc36c282 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1314 microversion: 2.1 time: 0.217852 Sep 18 00:57:21.509261 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 88/166] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:21 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:21.509667 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 79/167] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:21 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:22.529067 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d922ac9f-f713-4fc9-b4ed-a87fc44c5acc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:22.529674 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d922ac9f-f713-4fc9-b4ed-a87fc44c5acc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:22.536212 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e6a55e38-c6fd-423a-b583-47121daa794c tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:22.536723 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d922ac9f-f713-4fc9-b4ed-a87fc44c5acc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:22.536877 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e6a55e38-c6fd-423a-b583-47121daa794c tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:22.537178 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d922ac9f-f713-4fc9-b4ed-a87fc44c5acc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:22.537631 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d922ac9f-f713-4fc9-b4ed-a87fc44c5acc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:22.538326 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d922ac9f-f713-4fc9-b4ed-a87fc44c5acc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:22.538776 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d922ac9f-f713-4fc9-b4ed-a87fc44c5acc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:22.539219 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d922ac9f-f713-4fc9-b4ed-a87fc44c5acc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:22.542761 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6a55e38-c6fd-423a-b583-47121daa794c tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:22.543272 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6a55e38-c6fd-423a-b583-47121daa794c tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:22.543708 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6a55e38-c6fd-423a-b583-47121daa794c tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:22.544396 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6a55e38-c6fd-423a-b583-47121daa794c tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:22.544857 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6a55e38-c6fd-423a-b583-47121daa794c tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:22.545284 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6a55e38-c6fd-423a-b583-47121daa794c tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:22.730197 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d922ac9f-f713-4fc9-b4ed-a87fc44c5acc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:22.738335 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d922ac9f-f713-4fc9-b4ed-a87fc44c5acc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.213066 Sep 18 00:57:22.739226 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 89/168] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:22 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:22.742655 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-e6a55e38-c6fd-423a-b583-47121daa794c tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:22.750989 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e6a55e38-c6fd-423a-b583-47121daa794c tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1497 microversion: 2.1 time: 0.218579 Sep 18 00:57:22.751985 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 80/169] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:22 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:23.447045 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-bcdb9e5c-54e4-4e2c-87c3-5f114c2a15dd tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:23.447840 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-bcdb9e5c-54e4-4e2c-87c3-5f114c2a15dd tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:23.455113 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bcdb9e5c-54e4-4e2c-87c3-5f114c2a15dd tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:23.456320 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bcdb9e5c-54e4-4e2c-87c3-5f114c2a15dd tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:23.456847 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bcdb9e5c-54e4-4e2c-87c3-5f114c2a15dd tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:23.457568 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bcdb9e5c-54e4-4e2c-87c3-5f114c2a15dd tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:23.458068 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bcdb9e5c-54e4-4e2c-87c3-5f114c2a15dd tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:23.458644 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bcdb9e5c-54e4-4e2c-87c3-5f114c2a15dd tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:23.489036 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-bcdb9e5c-54e4-4e2c-87c3-5f114c2a15dd tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Going to try to terminate instance {{(pid=120686) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 00:57:23.569090 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-bcdb9e5c-54e4-4e2c-87c3-5f114c2a15dd tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 204 len: 0 microversion: 2.1 time: 0.126141 Sep 18 00:57:23.570225 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 90/170] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 00:57:23 2022] DELETE /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 00:57:23.579526 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1328fd3f-f134-473f-8818-77dba8f14c3a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:23.580194 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1328fd3f-f134-473f-8818-77dba8f14c3a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:23.587277 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1328fd3f-f134-473f-8818-77dba8f14c3a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:23.587798 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1328fd3f-f134-473f-8818-77dba8f14c3a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:23.588239 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1328fd3f-f134-473f-8818-77dba8f14c3a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:23.588932 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1328fd3f-f134-473f-8818-77dba8f14c3a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:23.589379 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1328fd3f-f134-473f-8818-77dba8f14c3a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:23.589803 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1328fd3f-f134-473f-8818-77dba8f14c3a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:23.726420 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1328fd3f-f134-473f-8818-77dba8f14c3a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:23.733930 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1328fd3f-f134-473f-8818-77dba8f14c3a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1503 microversion: 2.1 time: 0.158501 Sep 18 00:57:23.734484 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 81/171] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:23 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:23.763996 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f4360ddd-1cb5-42cf-ab67-9f3284dad4bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:23.764651 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f4360ddd-1cb5-42cf-ab67-9f3284dad4bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:23.770954 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4360ddd-1cb5-42cf-ab67-9f3284dad4bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:23.771430 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4360ddd-1cb5-42cf-ab67-9f3284dad4bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:23.771880 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4360ddd-1cb5-42cf-ab67-9f3284dad4bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:23.772561 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4360ddd-1cb5-42cf-ab67-9f3284dad4bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:23.773010 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4360ddd-1cb5-42cf-ab67-9f3284dad4bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:23.773427 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4360ddd-1cb5-42cf-ab67-9f3284dad4bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:23.912744 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f4360ddd-1cb5-42cf-ab67-9f3284dad4bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:23.922486 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f4360ddd-1cb5-42cf-ab67-9f3284dad4bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.163577 Sep 18 00:57:23.923080 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 91/172] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:23 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:24.758209 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-45de48fb-d0a8-46cb-99a8-6288d86fef4b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:24.758847 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-45de48fb-d0a8-46cb-99a8-6288d86fef4b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:24.765643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45de48fb-d0a8-46cb-99a8-6288d86fef4b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:24.766194 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45de48fb-d0a8-46cb-99a8-6288d86fef4b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:24.766637 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45de48fb-d0a8-46cb-99a8-6288d86fef4b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:24.767387 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45de48fb-d0a8-46cb-99a8-6288d86fef4b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:24.767900 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45de48fb-d0a8-46cb-99a8-6288d86fef4b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:24.768339 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45de48fb-d0a8-46cb-99a8-6288d86fef4b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:24.783779 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=100 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:24.905300 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-45de48fb-d0a8-46cb-99a8-6288d86fef4b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:24.913675 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-45de48fb-d0a8-46cb-99a8-6288d86fef4b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1503 microversion: 2.1 time: 0.159699 Sep 18 00:57:24.914259 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 82/173] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:24 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:24.951351 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-dfc24c0e-ae8d-487a-b9e8-8540b6be912e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:24.951986 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-dfc24c0e-ae8d-487a-b9e8-8540b6be912e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:24.959184 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfc24c0e-ae8d-487a-b9e8-8540b6be912e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:24.959665 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfc24c0e-ae8d-487a-b9e8-8540b6be912e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:24.960104 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfc24c0e-ae8d-487a-b9e8-8540b6be912e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:24.960800 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfc24c0e-ae8d-487a-b9e8-8540b6be912e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:24.961291 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfc24c0e-ae8d-487a-b9e8-8540b6be912e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:24.961718 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfc24c0e-ae8d-487a-b9e8-8540b6be912e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:25.094679 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-dfc24c0e-ae8d-487a-b9e8-8540b6be912e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:25.102705 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-dfc24c0e-ae8d-487a-b9e8-8540b6be912e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.155335 Sep 18 00:57:25.103299 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 92/174] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:24 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:25.937175 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3970b27f-4086-46f5-9214-cf2f54a437da tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:25.937849 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3970b27f-4086-46f5-9214-cf2f54a437da tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:25.948599 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3970b27f-4086-46f5-9214-cf2f54a437da tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:25.949100 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3970b27f-4086-46f5-9214-cf2f54a437da tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:25.949541 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3970b27f-4086-46f5-9214-cf2f54a437da tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:25.963328 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3970b27f-4086-46f5-9214-cf2f54a437da tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:25.964199 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3970b27f-4086-46f5-9214-cf2f54a437da tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:25.965748 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3970b27f-4086-46f5-9214-cf2f54a437da tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:26.128333 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ae89a0d4-c5f8-4c8b-8413-8d323305c423 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:26.129123 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ae89a0d4-c5f8-4c8b-8413-8d323305c423 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:26.136457 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ae89a0d4-c5f8-4c8b-8413-8d323305c423 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:26.136945 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ae89a0d4-c5f8-4c8b-8413-8d323305c423 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:26.137659 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ae89a0d4-c5f8-4c8b-8413-8d323305c423 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:26.138454 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ae89a0d4-c5f8-4c8b-8413-8d323305c423 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:26.139069 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ae89a0d4-c5f8-4c8b-8413-8d323305c423 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:26.139785 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ae89a0d4-c5f8-4c8b-8413-8d323305c423 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:26.208846 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3970b27f-4086-46f5-9214-cf2f54a437da tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:26.216622 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3970b27f-4086-46f5-9214-cf2f54a437da tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1503 microversion: 2.1 time: 0.283600 Sep 18 00:57:26.217395 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 83/175] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:25 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:26.354261 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ae89a0d4-c5f8-4c8b-8413-8d323305c423 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:26.366551 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ae89a0d4-c5f8-4c8b-8413-8d323305c423 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.244002 Sep 18 00:57:26.367557 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 93/176] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:26 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:26.505757 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-de85f17b-721a-4a9d-835a-c332eea3b971 req-98878a60-2fb4-4a6a-bb72-af8a176f7644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a299b3f6-a499-46c6-82f8-6cdefdb3bdab", "name": "network-vif-deleted", "tag": "6bf76ae4-15b2-4029-910e-ffa2a8b17d63"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:26.515445 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-de85f17b-721a-4a9d-835a-c332eea3b971 req-98878a60-2fb4-4a6a-bb72-af8a176f7644 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:26.515955 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-de85f17b-721a-4a9d-835a-c332eea3b971 req-98878a60-2fb4-4a6a-bb72-af8a176f7644 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:26.516382 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-de85f17b-721a-4a9d-835a-c332eea3b971 req-98878a60-2fb4-4a6a-bb72-af8a176f7644 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:26.528240 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-de85f17b-721a-4a9d-835a-c332eea3b971 req-98878a60-2fb4-4a6a-bb72-af8a176f7644 service nova] Creating event network-vif-deleted:6bf76ae4-15b2-4029-910e-ffa2a8b17d63 for instance a299b3f6-a499-46c6-82f8-6cdefdb3bdab on hv-cinder-maste Sep 18 00:57:26.533854 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-de85f17b-721a-4a9d-835a-c332eea3b971 req-98878a60-2fb4-4a6a-bb72-af8a176f7644 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032125 Sep 18 00:57:26.534479 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 84/177] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:57:27.239560 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:27.240802 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:27.250194 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:27.250693 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:27.251164 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:27.251876 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:27.252855 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:27.253281 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:27.288141 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:27.288686 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:27.289119 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:27.289564 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lazy-loading 'fault' on Instance uuid a299b3f6-a499-46c6-82f8-6cdefdb3bdab {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:57:27.332060 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:27.340775 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-dc2f53ef-ccee-402c-aa19-35876994fa35 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 200 len: 1304 microversion: 2.1 time: 0.105192 Sep 18 00:57:27.342016 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 94/178] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:27 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:27.392083 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4ab6cda2-05bc-45c2-a026-71a9816a67a3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:27.393397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4ab6cda2-05bc-45c2-a026-71a9816a67a3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:27.400107 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab6cda2-05bc-45c2-a026-71a9816a67a3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:27.400590 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab6cda2-05bc-45c2-a026-71a9816a67a3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:27.401358 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab6cda2-05bc-45c2-a026-71a9816a67a3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:27.402080 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab6cda2-05bc-45c2-a026-71a9816a67a3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:27.402538 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab6cda2-05bc-45c2-a026-71a9816a67a3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:27.402994 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab6cda2-05bc-45c2-a026-71a9816a67a3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:27.547930 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4ab6cda2-05bc-45c2-a026-71a9816a67a3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:27.558514 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4ab6cda2-05bc-45c2-a026-71a9816a67a3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.170509 Sep 18 00:57:27.559180 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 85/179] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:27 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:28.366514 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:28.367167 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: a299b3f6-a499-46c6-82f8-6cdefdb3bdab] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:28.375049 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:28.376006 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:28.376442 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:28.377447 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:28.377928 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:28.378447 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:28.393201 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] HTTP exception thrown: Instance a299b3f6-a499-46c6-82f8-6cdefdb3bdab could not be found. Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Request method failure captured: Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab HTTP/1.1 Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmzigiM8P_2mM0Ws59f6EMibEKUvWWVc6bibY1FSK3pag22hJSXl467FG-04cMypqS0yx8ZNItXxjdofRQemkPfalMpTFQa3u0Duu6FK_N-FWZxIR45eLvPzD8OB3RNgFa2ritDCZeZVJsrQEkX0kt9nyhjOCydiUS9ju3yVdw5RRvI Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 4760ac3b2a024eb7a0718a1420d492a9 Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-VolumesActionsTest-965930282 Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:57:28.394979 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4760ac3b2a024eb7a0718a1420d492a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4760ac3b2a024eb7a0718a1420d492a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4760ac3b2a024eb7a0718a1420d492a9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4760ac3b2a024eb7a0718a1420d492a9"}]}] Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-VolumesActionsTest-965930282 Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 4760ac3b2a024eb7a0718a1420d492a9 Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-VolumesActionsTest-965930282 Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-VolumesActionsTest-965930282-project Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: c083eff39e644588b8516dabbfbb719f Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-VolumesActionsTest-965930282-project Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance a299b3f6-a499-46c6-82f8-6cdefdb3bdab could not be found. Sep 18 00:57:28.396341 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'a299b3f6-a499-46c6-82f8-6cdefdb3bdab'} Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a299b3f6-a499-46c6-82f8-6cdefdb3bdab could not be found. Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:57:28.397098 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a299b3f6-a499-46c6-82f8-6cdefdb3bdab could not be found. Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a299b3f6-a499-46c6-82f8-6cdefdb3bdab could not be found. Sep 18 00:57:28.398257 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:28.399382 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Returning 404 to user: Instance a299b3f6-a499-46c6-82f8-6cdefdb3bdab could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:57:28.399382 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-fcaa1263-b097-4edd-8aaf-c13a28ad169d tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab" status: 404 len: 111 microversion: 2.1 time: 0.033654 Sep 18 00:57:28.408994 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 95/180] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:28 2022] GET /compute/v2.1/servers/a299b3f6-a499-46c6-82f8-6cdefdb3bdab => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 00:57:28.514759 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1281420611", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "networks": [{"uuid": "7aa7dca7-9cff-4b1a-8ea5-d2e6639d53b6"}]}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:28.570349 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] validate_networks() for [('7aa7dca7-9cff-4b1a-8ea5-d2e6639d53b6', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:57:28.588546 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fb0561bd-c4c9-4c2a-98fa-8a1956b86542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:28.589261 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-fb0561bd-c4c9-4c2a-98fa-8a1956b86542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:28.595503 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fb0561bd-c4c9-4c2a-98fa-8a1956b86542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:28.596204 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fb0561bd-c4c9-4c2a-98fa-8a1956b86542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:28.596645 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fb0561bd-c4c9-4c2a-98fa-8a1956b86542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:28.597347 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fb0561bd-c4c9-4c2a-98fa-8a1956b86542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:28.597967 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fb0561bd-c4c9-4c2a-98fa-8a1956b86542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:28.598403 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fb0561bd-c4c9-4c2a-98fa-8a1956b86542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:28.801828 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-fb0561bd-c4c9-4c2a-98fa-8a1956b86542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:28.813328 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-fb0561bd-c4c9-4c2a-98fa-8a1956b86542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.229265 Sep 18 00:57:28.814141 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 96/181] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:28 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:29.001672 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:57:29.003304 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:57:29.003742 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:57:29.004346 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:57:29.004830 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:57:29.015288 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:29.015838 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:29.016383 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:29.017200 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:29.018303 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:29.019190 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:29.038351 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Getting quotas for project 4760ac3b2a024eb7a0718a1420d492a9. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:57:29.043493 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Getting quotas for user c083eff39e644588b8516dabbfbb719f and project 4760ac3b2a024eb7a0718a1420d492a9. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:57:29.057226 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:57:29.061377 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:57:29.112093 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-fd274752-8858-4c4f-8c8f-1c250e5298b1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601096 Sep 18 00:57:29.112748 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 86/182] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:57:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:57:29.125753 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fe5460bf-24c5-480e-873e-73f99a95e418 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:29.126467 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-fe5460bf-24c5-480e-873e-73f99a95e418 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:29.194524 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-fe5460bf-24c5-480e-873e-73f99a95e418 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:29.204823 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-fe5460bf-24c5-480e-873e-73f99a95e418 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1214 microversion: 2.1 time: 0.080566 Sep 18 00:57:29.204823 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 97/183] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:29 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:29.837401 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-92c0c271-4dca-4b5a-b43e-9a94a5bc7280 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:29.838045 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-92c0c271-4dca-4b5a-b43e-9a94a5bc7280 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:29.841603 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:29.847284 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92c0c271-4dca-4b5a-b43e-9a94a5bc7280 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:29.847839 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92c0c271-4dca-4b5a-b43e-9a94a5bc7280 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:29.848210 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92c0c271-4dca-4b5a-b43e-9a94a5bc7280 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:29.848907 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92c0c271-4dca-4b5a-b43e-9a94a5bc7280 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:29.849363 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92c0c271-4dca-4b5a-b43e-9a94a5bc7280 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:29.849784 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92c0c271-4dca-4b5a-b43e-9a94a5bc7280 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:30.009577 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-92c0c271-4dca-4b5a-b43e-9a94a5bc7280 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:30.017923 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-92c0c271-4dca-4b5a-b43e-9a94a5bc7280 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.183924 Sep 18 00:57:30.018587 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 87/184] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:29 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:30.230033 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e69beaee-4fdc-4db1-9c63-e4ab8164eea5 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:30.230033 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e69beaee-4fdc-4db1-9c63-e4ab8164eea5 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:30.234587 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e69beaee-4fdc-4db1-9c63-e4ab8164eea5 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:30.235172 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e69beaee-4fdc-4db1-9c63-e4ab8164eea5 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:30.235673 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e69beaee-4fdc-4db1-9c63-e4ab8164eea5 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:30.236992 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e69beaee-4fdc-4db1-9c63-e4ab8164eea5 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:30.237770 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e69beaee-4fdc-4db1-9c63-e4ab8164eea5 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:30.238418 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e69beaee-4fdc-4db1-9c63-e4ab8164eea5 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:30.442715 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e69beaee-4fdc-4db1-9c63-e4ab8164eea5 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:30.451002 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e69beaee-4fdc-4db1-9c63-e4ab8164eea5 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1266 microversion: 2.1 time: 0.231071 Sep 18 00:57:30.451827 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 98/185] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:30 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:31.041110 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4d1a45ef-680c-4510-ab49-f6d77006fbb1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:31.041715 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4d1a45ef-680c-4510-ab49-f6d77006fbb1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:31.052042 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4d1a45ef-680c-4510-ab49-f6d77006fbb1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:31.052533 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4d1a45ef-680c-4510-ab49-f6d77006fbb1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:31.052962 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4d1a45ef-680c-4510-ab49-f6d77006fbb1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:31.053660 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4d1a45ef-680c-4510-ab49-f6d77006fbb1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:31.054109 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4d1a45ef-680c-4510-ab49-f6d77006fbb1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:31.054535 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4d1a45ef-680c-4510-ab49-f6d77006fbb1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:31.287821 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4d1a45ef-680c-4510-ab49-f6d77006fbb1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:31.298855 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4d1a45ef-680c-4510-ab49-f6d77006fbb1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.261423 Sep 18 00:57:31.299851 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 88/186] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:31 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:31.474456 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e7e554e1-1e48-4c98-8bb5-61492555b23b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:31.475921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e7e554e1-1e48-4c98-8bb5-61492555b23b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:31.484064 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e7e554e1-1e48-4c98-8bb5-61492555b23b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:31.484964 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e7e554e1-1e48-4c98-8bb5-61492555b23b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:31.485618 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e7e554e1-1e48-4c98-8bb5-61492555b23b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:31.487315 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e7e554e1-1e48-4c98-8bb5-61492555b23b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:31.488086 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e7e554e1-1e48-4c98-8bb5-61492555b23b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:31.488702 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e7e554e1-1e48-4c98-8bb5-61492555b23b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:31.881990 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e7e554e1-1e48-4c98-8bb5-61492555b23b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:31.914837 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e7e554e1-1e48-4c98-8bb5-61492555b23b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1314 microversion: 2.1 time: 0.444592 Sep 18 00:57:31.915961 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 99/187] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:31 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:32.321779 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-48a99633-a190-4cfa-9482-aba0ba9d1105 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:32.322392 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-48a99633-a190-4cfa-9482-aba0ba9d1105 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:32.328413 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48a99633-a190-4cfa-9482-aba0ba9d1105 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:32.329106 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48a99633-a190-4cfa-9482-aba0ba9d1105 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:32.329608 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48a99633-a190-4cfa-9482-aba0ba9d1105 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:32.331319 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48a99633-a190-4cfa-9482-aba0ba9d1105 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:32.332024 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48a99633-a190-4cfa-9482-aba0ba9d1105 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:32.332515 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48a99633-a190-4cfa-9482-aba0ba9d1105 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:32.340710 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-8f5c0889-67a0-4c0f-84dd-70f36c5b1b9d req-2156a28f-0a9d-48f3-8589-f5ee93eb3517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49", "tag": "87ff6755-8ad9-4c3b-8789-500acf6a5ccd"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:32.358362 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-8f5c0889-67a0-4c0f-84dd-70f36c5b1b9d req-2156a28f-0a9d-48f3-8589-f5ee93eb3517 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:32.358774 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-8f5c0889-67a0-4c0f-84dd-70f36c5b1b9d req-2156a28f-0a9d-48f3-8589-f5ee93eb3517 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:32.359237 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-8f5c0889-67a0-4c0f-84dd-70f36c5b1b9d req-2156a28f-0a9d-48f3-8589-f5ee93eb3517 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:32.374295 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-8f5c0889-67a0-4c0f-84dd-70f36c5b1b9d req-2156a28f-0a9d-48f3-8589-f5ee93eb3517 service nova] Creating event network-changed:87ff6755-8ad9-4c3b-8789-500acf6a5ccd for instance 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 on hv-cinder-maste Sep 18 00:57:32.383873 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-8f5c0889-67a0-4c0f-84dd-70f36c5b1b9d req-2156a28f-0a9d-48f3-8589-f5ee93eb3517 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048965 Sep 18 00:57:32.385488 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 100/188] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:57:32.585823 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-48a99633-a190-4cfa-9482-aba0ba9d1105 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:32.593734 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-48a99633-a190-4cfa-9482-aba0ba9d1105 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.276073 Sep 18 00:57:32.594664 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 89/189] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:32 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:32.940820 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fcff08a1-b2d3-4deb-b55e-c8c60d8303bc tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:32.943874 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-fcff08a1-b2d3-4deb-b55e-c8c60d8303bc tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:32.951236 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcff08a1-b2d3-4deb-b55e-c8c60d8303bc tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:32.952058 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcff08a1-b2d3-4deb-b55e-c8c60d8303bc tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:32.953525 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcff08a1-b2d3-4deb-b55e-c8c60d8303bc tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:32.954255 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcff08a1-b2d3-4deb-b55e-c8c60d8303bc tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:32.954922 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcff08a1-b2d3-4deb-b55e-c8c60d8303bc tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:32.955544 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fcff08a1-b2d3-4deb-b55e-c8c60d8303bc tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:33.111422 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-fcff08a1-b2d3-4deb-b55e-c8c60d8303bc tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:33.120067 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-fcff08a1-b2d3-4deb-b55e-c8c60d8303bc tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1314 microversion: 2.1 time: 0.184811 Sep 18 00:57:33.120639 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 101/190] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:32 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:33.616878 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f6485421-9ced-4e92-9921-d8c4480788d1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:33.617489 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f6485421-9ced-4e92-9921-d8c4480788d1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:33.623363 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6485421-9ced-4e92-9921-d8c4480788d1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:33.623840 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6485421-9ced-4e92-9921-d8c4480788d1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:33.624265 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6485421-9ced-4e92-9921-d8c4480788d1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:33.624942 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6485421-9ced-4e92-9921-d8c4480788d1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:33.625386 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6485421-9ced-4e92-9921-d8c4480788d1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:33.625802 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6485421-9ced-4e92-9921-d8c4480788d1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:33.774525 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f6485421-9ced-4e92-9921-d8c4480788d1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:33.782512 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f6485421-9ced-4e92-9921-d8c4480788d1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.169511 Sep 18 00:57:33.783770 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 90/191] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:33 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:34.149169 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8eadffc6-a448-42ba-8b12-42e16f412ba3 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:34.149785 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8eadffc6-a448-42ba-8b12-42e16f412ba3 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:34.157077 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8eadffc6-a448-42ba-8b12-42e16f412ba3 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:34.157566 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8eadffc6-a448-42ba-8b12-42e16f412ba3 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:34.158040 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8eadffc6-a448-42ba-8b12-42e16f412ba3 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:34.158977 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8eadffc6-a448-42ba-8b12-42e16f412ba3 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:34.159440 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8eadffc6-a448-42ba-8b12-42e16f412ba3 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:34.159863 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8eadffc6-a448-42ba-8b12-42e16f412ba3 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:34.378651 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-8eadffc6-a448-42ba-8b12-42e16f412ba3 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:34.389624 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8eadffc6-a448-42ba-8b12-42e16f412ba3 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1314 microversion: 2.1 time: 0.244062 Sep 18 00:57:34.403028 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 102/192] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:34 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:34.805752 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f2d81469-2a4f-49b1-a920-e0a4a024c00b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:34.806307 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f2d81469-2a4f-49b1-a920-e0a4a024c00b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:34.812383 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2d81469-2a4f-49b1-a920-e0a4a024c00b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:34.812883 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2d81469-2a4f-49b1-a920-e0a4a024c00b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:34.813310 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2d81469-2a4f-49b1-a920-e0a4a024c00b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:34.814052 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2d81469-2a4f-49b1-a920-e0a4a024c00b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:34.814519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2d81469-2a4f-49b1-a920-e0a4a024c00b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:34.814976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f2d81469-2a4f-49b1-a920-e0a4a024c00b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:34.957343 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f2d81469-2a4f-49b1-a920-e0a4a024c00b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:34.967393 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f2d81469-2a4f-49b1-a920-e0a4a024c00b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.165204 Sep 18 00:57:34.969717 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 91/193] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:34 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:35.416177 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1aff612a-fdfb-4b94-922f-ec6fdaa071ee tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:35.416799 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-1aff612a-fdfb-4b94-922f-ec6fdaa071ee tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:35.419375 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:35.424781 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1aff612a-fdfb-4b94-922f-ec6fdaa071ee tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:35.425697 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1aff612a-fdfb-4b94-922f-ec6fdaa071ee tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:35.426139 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1aff612a-fdfb-4b94-922f-ec6fdaa071ee tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:35.426871 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1aff612a-fdfb-4b94-922f-ec6fdaa071ee tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:35.427332 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1aff612a-fdfb-4b94-922f-ec6fdaa071ee tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:35.427757 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1aff612a-fdfb-4b94-922f-ec6fdaa071ee tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:35.447949 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:35.668098 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-1aff612a-fdfb-4b94-922f-ec6fdaa071ee tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:35.684794 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-1aff612a-fdfb-4b94-922f-ec6fdaa071ee tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1314 microversion: 2.1 time: 0.273053 Sep 18 00:57:35.685400 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 103/194] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:35 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:35.993546 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d6d37a75-d97e-440c-9525-b0c552172652 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:35.994255 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d6d37a75-d97e-440c-9525-b0c552172652 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:36.000834 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6d37a75-d97e-440c-9525-b0c552172652 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:36.001490 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6d37a75-d97e-440c-9525-b0c552172652 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:36.002719 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6d37a75-d97e-440c-9525-b0c552172652 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:36.003521 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6d37a75-d97e-440c-9525-b0c552172652 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:36.004071 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6d37a75-d97e-440c-9525-b0c552172652 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:36.005120 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6d37a75-d97e-440c-9525-b0c552172652 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:36.135338 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d6d37a75-d97e-440c-9525-b0c552172652 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:36.143696 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d6d37a75-d97e-440c-9525-b0c552172652 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.154294 Sep 18 00:57:36.144274 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 92/195] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:35 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:36.709077 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4cb2aafd-cf41-47a6-b429-1b82b5de6d2b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:36.709686 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-4cb2aafd-cf41-47a6-b429-1b82b5de6d2b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:36.716056 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4cb2aafd-cf41-47a6-b429-1b82b5de6d2b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:36.716534 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4cb2aafd-cf41-47a6-b429-1b82b5de6d2b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:36.716964 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4cb2aafd-cf41-47a6-b429-1b82b5de6d2b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:36.717645 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4cb2aafd-cf41-47a6-b429-1b82b5de6d2b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:36.718093 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4cb2aafd-cf41-47a6-b429-1b82b5de6d2b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:36.718510 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4cb2aafd-cf41-47a6-b429-1b82b5de6d2b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:36.853031 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-4cb2aafd-cf41-47a6-b429-1b82b5de6d2b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:36.860956 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-4cb2aafd-cf41-47a6-b429-1b82b5de6d2b tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1314 microversion: 2.1 time: 0.156488 Sep 18 00:57:36.861501 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 104/196] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:36 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:37.168245 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-60efcc31-fcd9-4fa7-93a6-e219dd873d26 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:37.169010 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-60efcc31-fcd9-4fa7-93a6-e219dd873d26 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:37.175187 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-60efcc31-fcd9-4fa7-93a6-e219dd873d26 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:37.175813 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-60efcc31-fcd9-4fa7-93a6-e219dd873d26 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:37.176349 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-60efcc31-fcd9-4fa7-93a6-e219dd873d26 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:37.177289 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-60efcc31-fcd9-4fa7-93a6-e219dd873d26 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:37.177870 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-60efcc31-fcd9-4fa7-93a6-e219dd873d26 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:37.178471 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-60efcc31-fcd9-4fa7-93a6-e219dd873d26 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:37.360198 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-60efcc31-fcd9-4fa7-93a6-e219dd873d26 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:37.368787 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-60efcc31-fcd9-4fa7-93a6-e219dd873d26 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1523 microversion: 2.1 time: 0.204623 Sep 18 00:57:37.369621 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 93/197] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:37 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:37.883351 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b5940206-8a50-4988-b631-bad55b6ce46a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:37.883961 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b5940206-8a50-4988-b631-bad55b6ce46a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:37.890452 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b5940206-8a50-4988-b631-bad55b6ce46a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:37.891138 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b5940206-8a50-4988-b631-bad55b6ce46a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:37.891596 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b5940206-8a50-4988-b631-bad55b6ce46a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:37.892540 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b5940206-8a50-4988-b631-bad55b6ce46a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:37.892998 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b5940206-8a50-4988-b631-bad55b6ce46a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:37.893423 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b5940206-8a50-4988-b631-bad55b6ce46a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:38.026248 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-b5940206-8a50-4988-b631-bad55b6ce46a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:38.035145 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b5940206-8a50-4988-b631-bad55b6ce46a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1314 microversion: 2.1 time: 0.155836 Sep 18 00:57:38.035722 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 105/198] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:37 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:38.322253 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-02cce766-ff14-4bbb-85cd-9c0cdaa20810 req-6f3a079f-ac51-49fe-ba71-ae32dc9e8d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49", "name": "network-vif-plugged", "status": "completed", "tag": "87ff6755-8ad9-4c3b-8789-500acf6a5ccd"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:38.333841 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-02cce766-ff14-4bbb-85cd-9c0cdaa20810 req-6f3a079f-ac51-49fe-ba71-ae32dc9e8d55 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:38.334571 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-02cce766-ff14-4bbb-85cd-9c0cdaa20810 req-6f3a079f-ac51-49fe-ba71-ae32dc9e8d55 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:38.335024 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-02cce766-ff14-4bbb-85cd-9c0cdaa20810 req-6f3a079f-ac51-49fe-ba71-ae32dc9e8d55 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:38.347165 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-02cce766-ff14-4bbb-85cd-9c0cdaa20810 req-6f3a079f-ac51-49fe-ba71-ae32dc9e8d55 service nova] Creating event network-vif-plugged:87ff6755-8ad9-4c3b-8789-500acf6a5ccd for instance 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 on hv-cinder-maste Sep 18 00:57:38.352132 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-02cce766-ff14-4bbb-85cd-9c0cdaa20810 req-6f3a079f-ac51-49fe-ba71-ae32dc9e8d55 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033489 Sep 18 00:57:38.352906 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 94/199] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:57:38.394070 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1cf51ba1-1e52-4986-88f9-71ee23c602d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:38.394694 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-1cf51ba1-1e52-4986-88f9-71ee23c602d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:38.400672 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1cf51ba1-1e52-4986-88f9-71ee23c602d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:38.401160 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1cf51ba1-1e52-4986-88f9-71ee23c602d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:38.401604 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1cf51ba1-1e52-4986-88f9-71ee23c602d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:38.402324 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1cf51ba1-1e52-4986-88f9-71ee23c602d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:38.402771 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1cf51ba1-1e52-4986-88f9-71ee23c602d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:38.403225 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1cf51ba1-1e52-4986-88f9-71ee23c602d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:38.552234 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-1cf51ba1-1e52-4986-88f9-71ee23c602d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:38.560458 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-1cf51ba1-1e52-4986-88f9-71ee23c602d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1503 microversion: 2.1 time: 0.170948 Sep 18 00:57:38.561120 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 106/200] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:38 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:38.584562 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e6e1b698-6fd4-4bf9-ba93-3205ee8a037a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:38.585282 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e6e1b698-6fd4-4bf9-ba93-3205ee8a037a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:38.591856 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6e1b698-6fd4-4bf9-ba93-3205ee8a037a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:38.592516 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6e1b698-6fd4-4bf9-ba93-3205ee8a037a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:38.592954 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6e1b698-6fd4-4bf9-ba93-3205ee8a037a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:38.593643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6e1b698-6fd4-4bf9-ba93-3205ee8a037a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:38.594094 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6e1b698-6fd4-4bf9-ba93-3205ee8a037a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:38.594513 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e6e1b698-6fd4-4bf9-ba93-3205ee8a037a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:38.742817 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-e6e1b698-6fd4-4bf9-ba93-3205ee8a037a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:38.750768 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e6e1b698-6fd4-4bf9-ba93-3205ee8a037a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1516 microversion: 2.1 time: 0.170978 Sep 18 00:57:38.751877 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 95/201] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:38 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:39.057571 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-eddbeb6c-de00-473c-bdcd-067945640b23 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:39.058361 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-eddbeb6c-de00-473c-bdcd-067945640b23 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:39.065894 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eddbeb6c-de00-473c-bdcd-067945640b23 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:39.066497 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eddbeb6c-de00-473c-bdcd-067945640b23 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:39.067041 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eddbeb6c-de00-473c-bdcd-067945640b23 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:39.067979 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eddbeb6c-de00-473c-bdcd-067945640b23 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:39.068445 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eddbeb6c-de00-473c-bdcd-067945640b23 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:39.068949 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eddbeb6c-de00-473c-bdcd-067945640b23 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:39.198908 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:39.237074 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-eddbeb6c-de00-473c-bdcd-067945640b23 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:39.244710 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-eddbeb6c-de00-473c-bdcd-067945640b23 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1314 microversion: 2.1 time: 0.191209 Sep 18 00:57:39.245279 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 107/202] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:39 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:40.205218 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e16e8967-c1f7-4c1d-8eec-4e23c310aa4c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:40.207175 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e16e8967-c1f7-4c1d-8eec-4e23c310aa4c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:40.209398 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:40.210096 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=6 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:40.216172 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e16e8967-c1f7-4c1d-8eec-4e23c310aa4c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:40.216663 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e16e8967-c1f7-4c1d-8eec-4e23c310aa4c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:40.217172 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e16e8967-c1f7-4c1d-8eec-4e23c310aa4c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:40.218203 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e16e8967-c1f7-4c1d-8eec-4e23c310aa4c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:40.219016 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e16e8967-c1f7-4c1d-8eec-4e23c310aa4c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:40.219523 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e16e8967-c1f7-4c1d-8eec-4e23c310aa4c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:40.268890 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c9b4ac97-dc82-4f60-8b40-b5c0be06578a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:40.270199 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c9b4ac97-dc82-4f60-8b40-b5c0be06578a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:40.278524 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b4ac97-dc82-4f60-8b40-b5c0be06578a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:40.281318 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b4ac97-dc82-4f60-8b40-b5c0be06578a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:40.281784 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b4ac97-dc82-4f60-8b40-b5c0be06578a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:40.283296 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b4ac97-dc82-4f60-8b40-b5c0be06578a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:40.284048 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b4ac97-dc82-4f60-8b40-b5c0be06578a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:40.284476 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b4ac97-dc82-4f60-8b40-b5c0be06578a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:40.293377 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-e16e8967-c1f7-4c1d-8eec-4e23c310aa4c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lazy-loading 'flavor' on Instance uuid bf75d794-7c36-40e0-a103-db749b9dd1e2 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:57:40.428026 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e16e8967-c1f7-4c1d-8eec-4e23c310aa4c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "POST /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2/action" status: 200 len: 32 microversion: 2.1 time: 0.228955 Sep 18 00:57:40.429005 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 96/203] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 00:57:40 2022] POST /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 00:57:40.434552 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c9b4ac97-dc82-4f60-8b40-b5c0be06578a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:40.440078 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-661a7cca-8f44-40fb-bf7b-bf2c2f3eaab7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:40.440775 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-661a7cca-8f44-40fb-bf7b-bf2c2f3eaab7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:40.443551 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c9b4ac97-dc82-4f60-8b40-b5c0be06578a tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1314 microversion: 2.1 time: 0.179137 Sep 18 00:57:40.444328 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 108/204] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:40 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:40.454938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-661a7cca-8f44-40fb-bf7b-bf2c2f3eaab7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:40.454938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-661a7cca-8f44-40fb-bf7b-bf2c2f3eaab7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:40.454938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-661a7cca-8f44-40fb-bf7b-bf2c2f3eaab7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:40.454938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-661a7cca-8f44-40fb-bf7b-bf2c2f3eaab7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:40.455336 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-661a7cca-8f44-40fb-bf7b-bf2c2f3eaab7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:40.455336 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-661a7cca-8f44-40fb-bf7b-bf2c2f3eaab7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:40.591752 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-661a7cca-8f44-40fb-bf7b-bf2c2f3eaab7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:40.602965 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-661a7cca-8f44-40fb-bf7b-bf2c2f3eaab7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.166656 Sep 18 00:57:40.603613 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 97/205] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:40 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:41.469122 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f7fe0504-ae52-402b-b47f-80cb19f841c1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:41.469763 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f7fe0504-ae52-402b-b47f-80cb19f841c1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:41.476200 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f7fe0504-ae52-402b-b47f-80cb19f841c1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:41.476687 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f7fe0504-ae52-402b-b47f-80cb19f841c1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:41.477124 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f7fe0504-ae52-402b-b47f-80cb19f841c1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:41.477822 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f7fe0504-ae52-402b-b47f-80cb19f841c1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:41.478279 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f7fe0504-ae52-402b-b47f-80cb19f841c1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:41.478703 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f7fe0504-ae52-402b-b47f-80cb19f841c1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:41.502057 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-49757b1f-d926-463d-aa22-3ea2ad7a68e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:41.502619 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-49757b1f-d926-463d-aa22-3ea2ad7a68e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:41.508889 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-49757b1f-d926-463d-aa22-3ea2ad7a68e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:41.509411 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-49757b1f-d926-463d-aa22-3ea2ad7a68e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:41.509903 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-49757b1f-d926-463d-aa22-3ea2ad7a68e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:41.510742 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-49757b1f-d926-463d-aa22-3ea2ad7a68e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:41.511380 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-49757b1f-d926-463d-aa22-3ea2ad7a68e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:41.511809 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-49757b1f-d926-463d-aa22-3ea2ad7a68e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:41.537040 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-49757b1f-d926-463d-aa22-3ea2ad7a68e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/ips" status: 200 len: 147 microversion: 2.1 time: 0.039551 Sep 18 00:57:41.543626 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 98/206] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 18 00:57:41 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:57:41.612595 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f7fe0504-ae52-402b-b47f-80cb19f841c1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:41.620603 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f7fe0504-ae52-402b-b47f-80cb19f841c1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1497 microversion: 2.1 time: 0.155287 Sep 18 00:57:41.627184 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-30578fa1-f7a6-4944-940d-aa019ed13d16 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:41.628095 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-30578fa1-f7a6-4944-940d-aa019ed13d16 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:41.631007 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 109/207] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:41 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:41.635141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-30578fa1-f7a6-4944-940d-aa019ed13d16 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:41.635782 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-30578fa1-f7a6-4944-940d-aa019ed13d16 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:41.636381 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-30578fa1-f7a6-4944-940d-aa019ed13d16 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:41.637560 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-30578fa1-f7a6-4944-940d-aa019ed13d16 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:41.638196 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-30578fa1-f7a6-4944-940d-aa019ed13d16 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:41.639008 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-30578fa1-f7a6-4944-940d-aa019ed13d16 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:41.659181 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:41.796147 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-30578fa1-f7a6-4944-940d-aa019ed13d16 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:41.805747 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-30578fa1-f7a6-4944-940d-aa019ed13d16 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.183141 Sep 18 00:57:41.806328 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 99/208] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:41 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:42.355624 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b259c233-b323-471b-b636-3f48a4fc4f88 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:42.356128 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b259c233-b323-471b-b636-3f48a4fc4f88 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:42.362413 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b259c233-b323-471b-b636-3f48a4fc4f88 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:42.362965 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b259c233-b323-471b-b636-3f48a4fc4f88 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:42.363407 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b259c233-b323-471b-b636-3f48a4fc4f88 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:42.364354 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b259c233-b323-471b-b636-3f48a4fc4f88 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:42.364962 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b259c233-b323-471b-b636-3f48a4fc4f88 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:42.365541 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b259c233-b323-471b-b636-3f48a4fc4f88 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:42.392700 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b259c233-b323-471b-b636-3f48a4fc4f88 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Going to try to terminate instance {{(pid=120686) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 00:57:42.482818 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b259c233-b323-471b-b636-3f48a4fc4f88 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "DELETE /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 204 len: 0 microversion: 2.1 time: 0.130551 Sep 18 00:57:42.483675 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 110/209] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 00:57:42 2022] DELETE /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 00:57:42.492672 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4286d22a-13c8-4aed-bc62-4dd04a9ece17 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:42.493374 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4286d22a-13c8-4aed-bc62-4dd04a9ece17 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:42.500059 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4286d22a-13c8-4aed-bc62-4dd04a9ece17 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:42.500550 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4286d22a-13c8-4aed-bc62-4dd04a9ece17 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:42.501519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4286d22a-13c8-4aed-bc62-4dd04a9ece17 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:42.502831 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4286d22a-13c8-4aed-bc62-4dd04a9ece17 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:42.503421 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4286d22a-13c8-4aed-bc62-4dd04a9ece17 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:42.503694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4286d22a-13c8-4aed-bc62-4dd04a9ece17 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:42.652728 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4286d22a-13c8-4aed-bc62-4dd04a9ece17 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:42.661214 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4286d22a-13c8-4aed-bc62-4dd04a9ece17 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1503 microversion: 2.1 time: 0.172656 Sep 18 00:57:42.661792 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 100/210] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:42 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:42.832612 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-bb535bb3-acbf-4225-b924-ee5325838056 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:42.833308 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-bb535bb3-acbf-4225-b924-ee5325838056 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:42.839180 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bb535bb3-acbf-4225-b924-ee5325838056 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:42.839673 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bb535bb3-acbf-4225-b924-ee5325838056 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:42.840170 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bb535bb3-acbf-4225-b924-ee5325838056 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:42.840817 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bb535bb3-acbf-4225-b924-ee5325838056 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:42.841272 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bb535bb3-acbf-4225-b924-ee5325838056 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:42.841700 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bb535bb3-acbf-4225-b924-ee5325838056 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:42.983295 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-bb535bb3-acbf-4225-b924-ee5325838056 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:42.992158 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-bb535bb3-acbf-4225-b924-ee5325838056 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.163867 Sep 18 00:57:42.993227 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 111/211] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:42 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:43.685368 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8a953e57-6fe9-41dc-9929-388d0e1792db tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:43.685981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8a953e57-6fe9-41dc-9929-388d0e1792db tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:43.692149 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a953e57-6fe9-41dc-9929-388d0e1792db tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:43.692636 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a953e57-6fe9-41dc-9929-388d0e1792db tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:43.693072 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a953e57-6fe9-41dc-9929-388d0e1792db tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:43.693764 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a953e57-6fe9-41dc-9929-388d0e1792db tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:43.694214 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a953e57-6fe9-41dc-9929-388d0e1792db tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:43.694638 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a953e57-6fe9-41dc-9929-388d0e1792db tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:43.827337 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8a953e57-6fe9-41dc-9929-388d0e1792db tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:43.836158 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8a953e57-6fe9-41dc-9929-388d0e1792db tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1503 microversion: 2.1 time: 0.154554 Sep 18 00:57:43.836731 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 101/212] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:43 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:44.017090 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-bf6a4d15-46ca-483e-a929-4f93c21ce770 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:44.017819 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-bf6a4d15-46ca-483e-a929-4f93c21ce770 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:44.024403 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bf6a4d15-46ca-483e-a929-4f93c21ce770 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:44.024894 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bf6a4d15-46ca-483e-a929-4f93c21ce770 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:44.025423 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bf6a4d15-46ca-483e-a929-4f93c21ce770 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:44.026136 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bf6a4d15-46ca-483e-a929-4f93c21ce770 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:44.026599 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bf6a4d15-46ca-483e-a929-4f93c21ce770 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:44.027074 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bf6a4d15-46ca-483e-a929-4f93c21ce770 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:44.171710 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-bf6a4d15-46ca-483e-a929-4f93c21ce770 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:44.180599 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-bf6a4d15-46ca-483e-a929-4f93c21ce770 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.167807 Sep 18 00:57:44.181321 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 112/213] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:44 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:44.858753 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-04fff1c2-8767-4ce9-8d94-e84fe021a0b2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:44.859519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-04fff1c2-8767-4ce9-8d94-e84fe021a0b2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:44.865568 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04fff1c2-8767-4ce9-8d94-e84fe021a0b2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:44.866056 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04fff1c2-8767-4ce9-8d94-e84fe021a0b2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:44.866488 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04fff1c2-8767-4ce9-8d94-e84fe021a0b2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:44.867215 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04fff1c2-8767-4ce9-8d94-e84fe021a0b2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:44.867841 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04fff1c2-8767-4ce9-8d94-e84fe021a0b2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:44.868417 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04fff1c2-8767-4ce9-8d94-e84fe021a0b2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:45.064979 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-04fff1c2-8767-4ce9-8d94-e84fe021a0b2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:45.074364 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-04fff1c2-8767-4ce9-8d94-e84fe021a0b2 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1503 microversion: 2.1 time: 0.219409 Sep 18 00:57:45.075303 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 102/214] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:44 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:45.205380 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-78ee5117-f1ca-40c8-8549-ddc84ce3dedd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:45.205998 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-78ee5117-f1ca-40c8-8549-ddc84ce3dedd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:45.206406 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-684ed9ba-a34c-46cf-856c-382d9fbdb3d0 req-b8d2b944-1e1d-4369-b9ac-4475beb382f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49", "name": "network-vif-deleted", "tag": "87ff6755-8ad9-4c3b-8789-500acf6a5ccd"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:45.213780 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78ee5117-f1ca-40c8-8549-ddc84ce3dedd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:45.214267 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78ee5117-f1ca-40c8-8549-ddc84ce3dedd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:45.214699 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78ee5117-f1ca-40c8-8549-ddc84ce3dedd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:45.215469 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78ee5117-f1ca-40c8-8549-ddc84ce3dedd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:45.216035 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78ee5117-f1ca-40c8-8549-ddc84ce3dedd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:45.216369 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78ee5117-f1ca-40c8-8549-ddc84ce3dedd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:45.218871 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-684ed9ba-a34c-46cf-856c-382d9fbdb3d0 req-b8d2b944-1e1d-4369-b9ac-4475beb382f6 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:45.219976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-684ed9ba-a34c-46cf-856c-382d9fbdb3d0 req-b8d2b944-1e1d-4369-b9ac-4475beb382f6 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:45.220956 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-684ed9ba-a34c-46cf-856c-382d9fbdb3d0 req-b8d2b944-1e1d-4369-b9ac-4475beb382f6 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:45.239735 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-684ed9ba-a34c-46cf-856c-382d9fbdb3d0 req-b8d2b944-1e1d-4369-b9ac-4475beb382f6 service nova] Creating event network-vif-deleted:87ff6755-8ad9-4c3b-8789-500acf6a5ccd for instance 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 on hv-cinder-maste Sep 18 00:57:45.245562 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-684ed9ba-a34c-46cf-856c-382d9fbdb3d0 req-b8d2b944-1e1d-4369-b9ac-4475beb382f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043792 Sep 18 00:57:45.247032 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 103/215] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:57:45.377536 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-78ee5117-f1ca-40c8-8549-ddc84ce3dedd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:45.391005 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-78ee5117-f1ca-40c8-8549-ddc84ce3dedd tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.189532 Sep 18 00:57:45.392899 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 113/216] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:45 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:46.098320 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:46.099756 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:46.106193 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:46.106721 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:46.107134 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:46.107831 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:46.108365 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:46.108795 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:46.142744 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:46.143489 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:46.143673 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:46.144608 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lazy-loading 'fault' on Instance uuid 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:57:46.197550 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c083eff39e644588b8516dabbfbb719f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ac3b2a024eb7a0718a1420d492a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:46.205540 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0bda0f48-f4c9-451b-9044-b6d134f956e1 tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 200 len: 1304 microversion: 2.1 time: 0.111550 Sep 18 00:57:46.206130 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 104/217] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:46 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:46.416316 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8afe9fa3-bbf2-4379-8c47-5a1924a23766 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:46.417065 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8afe9fa3-bbf2-4379-8c47-5a1924a23766 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:46.424274 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8afe9fa3-bbf2-4379-8c47-5a1924a23766 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:46.424759 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8afe9fa3-bbf2-4379-8c47-5a1924a23766 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:46.425198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8afe9fa3-bbf2-4379-8c47-5a1924a23766 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:46.425906 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8afe9fa3-bbf2-4379-8c47-5a1924a23766 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:46.426365 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8afe9fa3-bbf2-4379-8c47-5a1924a23766 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:46.426811 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8afe9fa3-bbf2-4379-8c47-5a1924a23766 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:46.565478 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-8afe9fa3-bbf2-4379-8c47-5a1924a23766 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:46.573207 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8afe9fa3-bbf2-4379-8c47-5a1924a23766 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.160933 Sep 18 00:57:46.573925 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 114/218] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:46 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:47.002952 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-82c21141-dd1d-4b1c-b0d5-6529f6c40938 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee3d5a96-89d8-4538-b903-f4bfae8fb1a7"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:47.006671 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-82c21141-dd1d-4b1c-b0d5-6529f6c40938 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:47.012990 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-82c21141-dd1d-4b1c-b0d5-6529f6c40938 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:47.013505 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-82c21141-dd1d-4b1c-b0d5-6529f6c40938 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:47.013935 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-82c21141-dd1d-4b1c-b0d5-6529f6c40938 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:47.014627 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-82c21141-dd1d-4b1c-b0d5-6529f6c40938 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:47.015103 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-82c21141-dd1d-4b1c-b0d5-6529f6c40938 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:47.015519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-82c21141-dd1d-4b1c-b0d5-6529f6c40938 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:47.230582 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:47.231232 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] [instance: 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:47.243883 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:47.244535 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:47.244976 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:47.248747 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:47.249236 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:47.249677 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:47.271831 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] HTTP exception thrown: Instance 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 could not be found. Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Request method failure captured: Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 HTTP/1.1 Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmzigiM8P_2mM0Ws59f6EMibEKUvWWVc6bibY1FSK3pag22hJSXl467FG-04cMypqS0yx8ZNItXxjdofRQemkPfalMpTFQa3u0Duu6FK_N-FWZxIR45eLvPzD8OB3RNgFa2ritDCZeZVJsrQEkX0kt9nyhjOCydiUS9ju3yVdw5RRvI Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 4760ac3b2a024eb7a0718a1420d492a9 Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-VolumesActionsTest-965930282 Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:57:47.274280 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4760ac3b2a024eb7a0718a1420d492a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4760ac3b2a024eb7a0718a1420d492a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4760ac3b2a024eb7a0718a1420d492a9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4760ac3b2a024eb7a0718a1420d492a9"}]}] Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-VolumesActionsTest-965930282 Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 4760ac3b2a024eb7a0718a1420d492a9 Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-VolumesActionsTest-965930282 Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-VolumesActionsTest-965930282-project Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: c083eff39e644588b8516dabbfbb719f Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-VolumesActionsTest-965930282-project Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 could not be found. Sep 18 00:57:47.275620 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49'} Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 could not be found. Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:57:47.276397 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 could not be found. Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 could not be found. Sep 18 00:57:47.277799 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:57:47.280178 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] Returning 404 to user: Instance 39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:57:47.281982 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-60ef113c-ff2f-4dc8-891d-728b84a6905e tempest-VolumesActionsTest-965930282 tempest-VolumesActionsTest-965930282-project] 10.222.0.33 "GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49" status: 404 len: 111 microversion: 2.1 time: 0.054885 Sep 18 00:57:47.283017 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 115/219] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:47 2022] GET /compute/v2.1/servers/39d52f6e-d2fc-4ca1-9d62-4c71d33cbb49 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 00:57:47.404297 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-82c21141-dd1d-4b1c-b0d5-6529f6c40938 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "POST /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406331 Sep 18 00:57:47.405093 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 105/220] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 00:57:46 2022] POST /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:57:47.599350 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ca4032b5-0fd3-49a9-a66b-8975e80cb1fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:47.599796 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ca4032b5-0fd3-49a9-a66b-8975e80cb1fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:47.608610 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4032b5-0fd3-49a9-a66b-8975e80cb1fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:47.608817 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4032b5-0fd3-49a9-a66b-8975e80cb1fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:47.609250 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4032b5-0fd3-49a9-a66b-8975e80cb1fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:47.610602 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4032b5-0fd3-49a9-a66b-8975e80cb1fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:47.611097 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4032b5-0fd3-49a9-a66b-8975e80cb1fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:47.614835 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4032b5-0fd3-49a9-a66b-8975e80cb1fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:47.769892 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ca4032b5-0fd3-49a9-a66b-8975e80cb1fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:47.782907 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ca4032b5-0fd3-49a9-a66b-8975e80cb1fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.187342 Sep 18 00:57:47.783749 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 116/221] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:47 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:48.810007 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8763bfa3-d909-4f51-a4c4-dec808918a4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:48.810711 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8763bfa3-d909-4f51-a4c4-dec808918a4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:48.817691 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8763bfa3-d909-4f51-a4c4-dec808918a4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:48.818177 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8763bfa3-d909-4f51-a4c4-dec808918a4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:48.818607 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8763bfa3-d909-4f51-a4c4-dec808918a4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:48.819371 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8763bfa3-d909-4f51-a4c4-dec808918a4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:48.819831 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8763bfa3-d909-4f51-a4c4-dec808918a4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:48.820250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8763bfa3-d909-4f51-a4c4-dec808918a4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:48.969159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8763bfa3-d909-4f51-a4c4-dec808918a4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:48.984239 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8763bfa3-d909-4f51-a4c4-dec808918a4b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.180685 Sep 18 00:57:48.998842 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 106/222] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:48 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:49.671270 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-eea34003-3922-4b45-ad2a-22dba63ce329 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:49.678430 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eea34003-3922-4b45-ad2a-22dba63ce329 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:49.678963 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eea34003-3922-4b45-ad2a-22dba63ce329 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:49.679405 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eea34003-3922-4b45-ad2a-22dba63ce329 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:49.747020 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-eea34003-3922-4b45-ad2a-22dba63ce329 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Going to try to stop instance {{(pid=120686) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 00:57:49.794567 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-eea34003-3922-4b45-ad2a-22dba63ce329 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "POST /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/action" status: 202 len: 0 microversion: 2.1 time: 0.127039 Sep 18 00:57:49.795205 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 117/223] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 00:57:49 2022] POST /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 00:57:49.808740 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-ada8c77e-7adb-49ea-a4a2-4b6736a53f91 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:49.809359 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-ada8c77e-7adb-49ea-a4a2-4b6736a53f91 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:49.819151 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ada8c77e-7adb-49ea-a4a2-4b6736a53f91 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:49.819151 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ada8c77e-7adb-49ea-a4a2-4b6736a53f91 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:49.819151 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ada8c77e-7adb-49ea-a4a2-4b6736a53f91 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:49.820078 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ada8c77e-7adb-49ea-a4a2-4b6736a53f91 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:49.820280 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ada8c77e-7adb-49ea-a4a2-4b6736a53f91 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:49.820716 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ada8c77e-7adb-49ea-a4a2-4b6736a53f91 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:49.972516 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ada8c77e-7adb-49ea-a4a2-4b6736a53f91 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:49.983090 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-ada8c77e-7adb-49ea-a4a2-4b6736a53f91 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.181777 Sep 18 00:57:49.986840 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 107/224] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:49 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:50.011003 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-00561d7e-03fa-4019-8266-61def3efde86 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:50.011626 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-00561d7e-03fa-4019-8266-61def3efde86 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:50.019384 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00561d7e-03fa-4019-8266-61def3efde86 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:50.019871 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00561d7e-03fa-4019-8266-61def3efde86 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:50.020315 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00561d7e-03fa-4019-8266-61def3efde86 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:50.021028 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00561d7e-03fa-4019-8266-61def3efde86 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:50.021482 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00561d7e-03fa-4019-8266-61def3efde86 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:50.022042 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-00561d7e-03fa-4019-8266-61def3efde86 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:50.026573 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:50.163525 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-00561d7e-03fa-4019-8266-61def3efde86 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:50.172538 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-00561d7e-03fa-4019-8266-61def3efde86 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.165581 Sep 18 00:57:50.174991 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 118/225] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:50 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:51.006400 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9e9a5a6b-6272-4907-8a4c-e059313d9474 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:51.007053 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9e9a5a6b-6272-4907-8a4c-e059313d9474 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:51.014261 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e9a5a6b-6272-4907-8a4c-e059313d9474 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:51.014756 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e9a5a6b-6272-4907-8a4c-e059313d9474 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:51.015238 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e9a5a6b-6272-4907-8a4c-e059313d9474 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:51.016669 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e9a5a6b-6272-4907-8a4c-e059313d9474 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:51.017363 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e9a5a6b-6272-4907-8a4c-e059313d9474 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:51.017797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e9a5a6b-6272-4907-8a4c-e059313d9474 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:51.161570 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9e9a5a6b-6272-4907-8a4c-e059313d9474 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:51.169873 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9e9a5a6b-6272-4907-8a4c-e059313d9474 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.167553 Sep 18 00:57:51.170440 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 108/226] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:51 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:51.226200 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b382bf99-7e5a-4f20-b4da-15e63448f017 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:51.227546 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b382bf99-7e5a-4f20-b4da-15e63448f017 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:51.237759 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b382bf99-7e5a-4f20-b4da-15e63448f017 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:51.238427 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b382bf99-7e5a-4f20-b4da-15e63448f017 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:51.239042 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b382bf99-7e5a-4f20-b4da-15e63448f017 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:51.239845 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b382bf99-7e5a-4f20-b4da-15e63448f017 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:51.240413 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b382bf99-7e5a-4f20-b4da-15e63448f017 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:51.240944 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b382bf99-7e5a-4f20-b4da-15e63448f017 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:51.384916 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-b382bf99-7e5a-4f20-b4da-15e63448f017 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:51.394634 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b382bf99-7e5a-4f20-b4da-15e63448f017 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.173893 Sep 18 00:57:51.395321 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 119/227] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:51 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:52.196284 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e2b6244c-9a09-43a9-bc65-c606023d6947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:52.196905 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e2b6244c-9a09-43a9-bc65-c606023d6947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:52.208777 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e2b6244c-9a09-43a9-bc65-c606023d6947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:52.210174 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e2b6244c-9a09-43a9-bc65-c606023d6947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:52.211770 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e2b6244c-9a09-43a9-bc65-c606023d6947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:52.212824 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e2b6244c-9a09-43a9-bc65-c606023d6947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:52.213671 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e2b6244c-9a09-43a9-bc65-c606023d6947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:52.214196 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e2b6244c-9a09-43a9-bc65-c606023d6947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:52.396583 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-e2b6244c-9a09-43a9-bc65-c606023d6947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:52.405310 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e2b6244c-9a09-43a9-bc65-c606023d6947 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.214229 Sep 18 00:57:52.405893 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 109/228] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:52 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:52.423245 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d7dcc10d-2e99-44d6-bbcf-ecd7ee6d4db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:52.424086 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d7dcc10d-2e99-44d6-bbcf-ecd7ee6d4db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:52.432613 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d7dcc10d-2e99-44d6-bbcf-ecd7ee6d4db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:52.433613 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d7dcc10d-2e99-44d6-bbcf-ecd7ee6d4db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:52.434249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d7dcc10d-2e99-44d6-bbcf-ecd7ee6d4db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:52.435728 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d7dcc10d-2e99-44d6-bbcf-ecd7ee6d4db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:52.436366 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d7dcc10d-2e99-44d6-bbcf-ecd7ee6d4db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:52.437260 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d7dcc10d-2e99-44d6-bbcf-ecd7ee6d4db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:52.667317 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d7dcc10d-2e99-44d6-bbcf-ecd7ee6d4db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:52.678780 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d7dcc10d-2e99-44d6-bbcf-ecd7ee6d4db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.264650 Sep 18 00:57:52.679739 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 120/229] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:52 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:53.150504 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8997d7fd-6b0d-482d-b1e8-8f9b7f795004 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:53.151788 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8997d7fd-6b0d-482d-b1e8-8f9b7f795004 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:53.159414 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8997d7fd-6b0d-482d-b1e8-8f9b7f795004 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:53.160559 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8997d7fd-6b0d-482d-b1e8-8f9b7f795004 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:53.161244 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8997d7fd-6b0d-482d-b1e8-8f9b7f795004 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:53.162220 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8997d7fd-6b0d-482d-b1e8-8f9b7f795004 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:53.167113 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8997d7fd-6b0d-482d-b1e8-8f9b7f795004 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:53.168744 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8997d7fd-6b0d-482d-b1e8-8f9b7f795004 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:53.202109 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8997d7fd-6b0d-482d-b1e8-8f9b7f795004 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/ips" status: 200 len: 153 microversion: 2.20 time: 0.058170 Sep 18 00:57:53.203400 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 110/230] 10.222.0.33 () {60 vars in 1289 bytes} [Sun Sep 18 00:57:53 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/ips => generated 153 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:57:53.432202 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-44bfcb61-88a0-4016-a70c-7c16448da744 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:53.433927 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-44bfcb61-88a0-4016-a70c-7c16448da744 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:53.455752 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44bfcb61-88a0-4016-a70c-7c16448da744 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:53.455752 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44bfcb61-88a0-4016-a70c-7c16448da744 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:53.455752 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44bfcb61-88a0-4016-a70c-7c16448da744 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:53.455752 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44bfcb61-88a0-4016-a70c-7c16448da744 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:53.456241 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44bfcb61-88a0-4016-a70c-7c16448da744 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:53.457002 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44bfcb61-88a0-4016-a70c-7c16448da744 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:53.697016 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-44bfcb61-88a0-4016-a70c-7c16448da744 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:53.715951 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0841096f-71dd-4ea5-b907-9788904b80dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:53.717915 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0841096f-71dd-4ea5-b907-9788904b80dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:53.721222 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-44bfcb61-88a0-4016-a70c-7c16448da744 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.295061 Sep 18 00:57:53.727061 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 121/231] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:53 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:53.733626 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0841096f-71dd-4ea5-b907-9788904b80dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:53.734954 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0841096f-71dd-4ea5-b907-9788904b80dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:53.735994 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0841096f-71dd-4ea5-b907-9788904b80dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:53.737793 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0841096f-71dd-4ea5-b907-9788904b80dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:53.739912 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0841096f-71dd-4ea5-b907-9788904b80dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:53.740979 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0841096f-71dd-4ea5-b907-9788904b80dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:53.949032 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0841096f-71dd-4ea5-b907-9788904b80dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:53.958388 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0841096f-71dd-4ea5-b907-9788904b80dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.258013 Sep 18 00:57:53.959178 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 111/232] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:53 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:54.751021 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-5e95dbc4-a8b9-4c82-9e11-4a2ecd6f7f35 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:54.752605 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-5e95dbc4-a8b9-4c82-9e11-4a2ecd6f7f35 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:54.760842 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5e95dbc4-a8b9-4c82-9e11-4a2ecd6f7f35 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:54.761405 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5e95dbc4-a8b9-4c82-9e11-4a2ecd6f7f35 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:54.761898 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5e95dbc4-a8b9-4c82-9e11-4a2ecd6f7f35 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:54.762836 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5e95dbc4-a8b9-4c82-9e11-4a2ecd6f7f35 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:54.763617 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5e95dbc4-a8b9-4c82-9e11-4a2ecd6f7f35 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:54.764039 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5e95dbc4-a8b9-4c82-9e11-4a2ecd6f7f35 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:54.902407 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-5e95dbc4-a8b9-4c82-9e11-4a2ecd6f7f35 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:54.910747 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-5e95dbc4-a8b9-4c82-9e11-4a2ecd6f7f35 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.164963 Sep 18 00:57:54.911343 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 122/233] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:54 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:54.987409 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-018a015c-f0c7-4cc1-9b87-45393c67e0b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:54.988022 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-018a015c-f0c7-4cc1-9b87-45393c67e0b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:54.994481 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-018a015c-f0c7-4cc1-9b87-45393c67e0b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:54.995011 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-018a015c-f0c7-4cc1-9b87-45393c67e0b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:54.995455 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-018a015c-f0c7-4cc1-9b87-45393c67e0b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:54.996143 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-018a015c-f0c7-4cc1-9b87-45393c67e0b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:54.996601 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-018a015c-f0c7-4cc1-9b87-45393c67e0b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:54.997031 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-018a015c-f0c7-4cc1-9b87-45393c67e0b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:55.127591 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-018a015c-f0c7-4cc1-9b87-45393c67e0b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:55.136444 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-018a015c-f0c7-4cc1-9b87-45393c67e0b9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.153124 Sep 18 00:57:55.137013 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 112/234] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:54 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:55.937500 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-539a03e2-000c-4b81-80e5-efb58be24f13 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:55.938265 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-539a03e2-000c-4b81-80e5-efb58be24f13 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:55.947081 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539a03e2-000c-4b81-80e5-efb58be24f13 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:55.947785 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539a03e2-000c-4b81-80e5-efb58be24f13 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:55.948229 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539a03e2-000c-4b81-80e5-efb58be24f13 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:55.948958 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539a03e2-000c-4b81-80e5-efb58be24f13 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:55.953912 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539a03e2-000c-4b81-80e5-efb58be24f13 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:55.954493 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539a03e2-000c-4b81-80e5-efb58be24f13 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:56.162534 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7a7b95e7-c48e-4a21-926b-2d226d2ac51b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:56.164767 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7a7b95e7-c48e-4a21-926b-2d226d2ac51b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:56.183066 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a7b95e7-c48e-4a21-926b-2d226d2ac51b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:56.183980 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a7b95e7-c48e-4a21-926b-2d226d2ac51b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:56.184717 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a7b95e7-c48e-4a21-926b-2d226d2ac51b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:56.192318 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a7b95e7-c48e-4a21-926b-2d226d2ac51b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:56.193174 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a7b95e7-c48e-4a21-926b-2d226d2ac51b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:56.194202 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a7b95e7-c48e-4a21-926b-2d226d2ac51b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:56.444165 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-539a03e2-000c-4b81-80e5-efb58be24f13 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:56.465441 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-539a03e2-000c-4b81-80e5-efb58be24f13 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.533007 Sep 18 00:57:56.466214 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 123/235] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:55 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:56.561130 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7a7b95e7-c48e-4a21-926b-2d226d2ac51b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:56.574450 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7a7b95e7-c48e-4a21-926b-2d226d2ac51b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.419264 Sep 18 00:57:56.575491 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 113/236] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:56 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:57.490718 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-6efa4de1-3a78-46dd-9dbb-d88508c38e53 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:57.491692 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6efa4de1-3a78-46dd-9dbb-d88508c38e53 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:57.499482 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6efa4de1-3a78-46dd-9dbb-d88508c38e53 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:57.500665 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6efa4de1-3a78-46dd-9dbb-d88508c38e53 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:57.501135 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6efa4de1-3a78-46dd-9dbb-d88508c38e53 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:57.502037 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6efa4de1-3a78-46dd-9dbb-d88508c38e53 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:57.503013 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6efa4de1-3a78-46dd-9dbb-d88508c38e53 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:57.503455 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6efa4de1-3a78-46dd-9dbb-d88508c38e53 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:57.599368 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3bae3a64-ca44-4bc2-8759-49f562248895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:57.601217 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3bae3a64-ca44-4bc2-8759-49f562248895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:57.611444 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bae3a64-ca44-4bc2-8759-49f562248895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:57.611937 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bae3a64-ca44-4bc2-8759-49f562248895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:57.612376 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bae3a64-ca44-4bc2-8759-49f562248895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:57.613335 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bae3a64-ca44-4bc2-8759-49f562248895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:57.613797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bae3a64-ca44-4bc2-8759-49f562248895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:57.614462 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3bae3a64-ca44-4bc2-8759-49f562248895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:57.643255 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6efa4de1-3a78-46dd-9dbb-d88508c38e53 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:57.654721 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-6efa4de1-3a78-46dd-9dbb-d88508c38e53 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.168055 Sep 18 00:57:57.655374 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 124/237] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:57 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:57.769836 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3bae3a64-ca44-4bc2-8759-49f562248895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:57.783440 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3bae3a64-ca44-4bc2-8759-49f562248895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.188271 Sep 18 00:57:57.784017 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 114/238] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:57 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:57.980695 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-489030cf-c2bf-4c38-9f01-8ac2ad5dd6d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:57:57.981308 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-489030cf-c2bf-4c38-9f01-8ac2ad5dd6d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:58.001959 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-489030cf-c2bf-4c38-9f01-8ac2ad5dd6d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:58.002923 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-489030cf-c2bf-4c38-9f01-8ac2ad5dd6d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:58.003538 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-489030cf-c2bf-4c38-9f01-8ac2ad5dd6d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:58.004565 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-489030cf-c2bf-4c38-9f01-8ac2ad5dd6d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:58.005206 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-489030cf-c2bf-4c38-9f01-8ac2ad5dd6d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:58.005798 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-489030cf-c2bf-4c38-9f01-8ac2ad5dd6d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:58.031607 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-489030cf-c2bf-4c38-9f01-8ac2ad5dd6d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lazy-loading 'flavor' on Instance uuid c1cf145a-d8d5-4a7e-937b-729bf79629fa {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:57:58.680717 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7d1157e6-23ca-4ee2-a944-93042819d520 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:58.682022 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7d1157e6-23ca-4ee2-a944-93042819d520 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:58.694366 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d1157e6-23ca-4ee2-a944-93042819d520 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:58.695126 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d1157e6-23ca-4ee2-a944-93042819d520 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:58.695565 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d1157e6-23ca-4ee2-a944-93042819d520 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:58.696427 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d1157e6-23ca-4ee2-a944-93042819d520 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:58.697044 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d1157e6-23ca-4ee2-a944-93042819d520 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:58.697627 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d1157e6-23ca-4ee2-a944-93042819d520 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:58.714959 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:58.887971 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7d1157e6-23ca-4ee2-a944-93042819d520 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:58.899187 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7d1157e6-23ca-4ee2-a944-93042819d520 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.223548 Sep 18 00:57:58.927916 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 115/239] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:58 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:57:58.933105 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-ea6bbfca-f3a0-4553-b020-3c3a855891a7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:58.934150 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-ea6bbfca-f3a0-4553-b020-3c3a855891a7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:58.941922 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea6bbfca-f3a0-4553-b020-3c3a855891a7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:58.942673 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea6bbfca-f3a0-4553-b020-3c3a855891a7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:58.945473 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea6bbfca-f3a0-4553-b020-3c3a855891a7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:58.946576 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea6bbfca-f3a0-4553-b020-3c3a855891a7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:58.947311 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea6bbfca-f3a0-4553-b020-3c3a855891a7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:58.947949 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea6bbfca-f3a0-4553-b020-3c3a855891a7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:59.178516 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ea6bbfca-f3a0-4553-b020-3c3a855891a7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:59.192163 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-ea6bbfca-f3a0-4553-b020-3c3a855891a7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.260474 Sep 18 00:57:59.209185 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 116/240] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:58 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:57:59.300388 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-489030cf-c2bf-4c38-9f01-8ac2ad5dd6d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "POST /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/action" status: 202 len: 0 microversion: 2.20 time: 1.323221 Sep 18 00:57:59.301994 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 125/241] 10.222.0.33 () {62 vars in 1319 bytes} [Sun Sep 18 00:57:57 2022] POST /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/action => generated 0 bytes in 1329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 00:57:59.310295 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:59.311184 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:59.323494 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:59.324772 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:59.325667 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:59.326921 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:59.328390 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:59.329322 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:59.529864 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:59.540108 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:59.541794 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:57:59.543191 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3e728f08-b001-4477-81b2-1791871736d1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.236741 Sep 18 00:57:59.543849 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 117/242] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:57:59 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:57:59.934780 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-aa06a3a8-2dca-4c8e-a793-9d2d53d2da56 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:57:59.935933 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-aa06a3a8-2dca-4c8e-a793-9d2d53d2da56 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:57:59.944498 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aa06a3a8-2dca-4c8e-a793-9d2d53d2da56 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:59.944961 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aa06a3a8-2dca-4c8e-a793-9d2d53d2da56 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:59.945394 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aa06a3a8-2dca-4c8e-a793-9d2d53d2da56 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:57:59.946088 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aa06a3a8-2dca-4c8e-a793-9d2d53d2da56 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:57:59.946567 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aa06a3a8-2dca-4c8e-a793-9d2d53d2da56 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:57:59.947011 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aa06a3a8-2dca-4c8e-a793-9d2d53d2da56 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:00.085131 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-aa06a3a8-2dca-4c8e-a793-9d2d53d2da56 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:00.099810 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-aa06a3a8-2dca-4c8e-a793-9d2d53d2da56 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.175074 Sep 18 00:58:00.101070 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 126/243] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:57:59 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:00.216679 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-67fedc97-6a65-4150-83a7-ab2b2a1f472b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:00.217320 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-67fedc97-6a65-4150-83a7-ab2b2a1f472b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:00.220185 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=64 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:00.225487 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67fedc97-6a65-4150-83a7-ab2b2a1f472b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:00.225976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67fedc97-6a65-4150-83a7-ab2b2a1f472b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:00.226410 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67fedc97-6a65-4150-83a7-ab2b2a1f472b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:00.227136 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67fedc97-6a65-4150-83a7-ab2b2a1f472b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:00.227595 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67fedc97-6a65-4150-83a7-ab2b2a1f472b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:00.228018 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67fedc97-6a65-4150-83a7-ab2b2a1f472b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:00.373410 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-67fedc97-6a65-4150-83a7-ab2b2a1f472b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:00.382386 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-67fedc97-6a65-4150-83a7-ab2b2a1f472b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.169450 Sep 18 00:58:00.382876 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 118/244] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:00 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:00.574106 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:00.576036 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:00.586034 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:00.587211 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:00.587855 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:00.588900 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:00.589709 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:00.590529 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:00.772358 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:00.786241 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:00.788448 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:00.789743 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-87ce0496-3b00-4618-8bf1-59d7ec0b4773 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.224070 Sep 18 00:58:00.790535 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 127/245] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:00 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:01.126416 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-57752090-869d-47c6-8639-0518a661d4a0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:01.127254 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-57752090-869d-47c6-8639-0518a661d4a0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:01.140443 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57752090-869d-47c6-8639-0518a661d4a0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:01.141024 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57752090-869d-47c6-8639-0518a661d4a0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:01.142179 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57752090-869d-47c6-8639-0518a661d4a0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:01.143212 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57752090-869d-47c6-8639-0518a661d4a0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:01.143836 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57752090-869d-47c6-8639-0518a661d4a0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:01.144417 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57752090-869d-47c6-8639-0518a661d4a0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:01.425995 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-15c33867-6e36-456b-aba9-8064cdd1806e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:01.426658 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-15c33867-6e36-456b-aba9-8064cdd1806e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:01.452552 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-15c33867-6e36-456b-aba9-8064cdd1806e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:01.453263 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-15c33867-6e36-456b-aba9-8064cdd1806e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:01.453710 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-15c33867-6e36-456b-aba9-8064cdd1806e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:01.454454 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-15c33867-6e36-456b-aba9-8064cdd1806e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:01.454958 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-15c33867-6e36-456b-aba9-8064cdd1806e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:01.455392 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-15c33867-6e36-456b-aba9-8064cdd1806e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:01.609563 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-57752090-869d-47c6-8639-0518a661d4a0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:01.619132 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-57752090-869d-47c6-8639-0518a661d4a0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.499353 Sep 18 00:58:01.633235 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 119/246] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:01 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:01.712322 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-15c33867-6e36-456b-aba9-8064cdd1806e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:01.724322 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-15c33867-6e36-456b-aba9-8064cdd1806e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.302887 Sep 18 00:58:01.743242 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 128/247] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:01 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:01.815977 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:01.817065 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:01.824437 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:01.825183 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:01.825852 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:01.826745 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:01.827497 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:01.828142 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:02.073534 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:02.083115 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:02.084548 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:02.085724 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0a258adf-74b8-4638-a836-e8bdd1e7c2f1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.274247 Sep 18 00:58:02.086286 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 120/248] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:01 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:02.644962 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fabfc7da-047a-4803-88f1-81539fd5ec99 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:02.645585 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-fabfc7da-047a-4803-88f1-81539fd5ec99 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:02.661267 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fabfc7da-047a-4803-88f1-81539fd5ec99 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:02.662513 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fabfc7da-047a-4803-88f1-81539fd5ec99 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:02.664293 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fabfc7da-047a-4803-88f1-81539fd5ec99 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:02.665730 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fabfc7da-047a-4803-88f1-81539fd5ec99 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:02.666891 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fabfc7da-047a-4803-88f1-81539fd5ec99 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:02.668682 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fabfc7da-047a-4803-88f1-81539fd5ec99 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:02.760181 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b8be6bd5-4081-4a2d-a50f-73f65bf0ce05 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:02.760807 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b8be6bd5-4081-4a2d-a50f-73f65bf0ce05 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:02.777549 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8be6bd5-4081-4a2d-a50f-73f65bf0ce05 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:02.787548 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8be6bd5-4081-4a2d-a50f-73f65bf0ce05 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:02.788136 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8be6bd5-4081-4a2d-a50f-73f65bf0ce05 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:02.789349 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8be6bd5-4081-4a2d-a50f-73f65bf0ce05 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:02.790217 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8be6bd5-4081-4a2d-a50f-73f65bf0ce05 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:02.790730 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8be6bd5-4081-4a2d-a50f-73f65bf0ce05 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:02.961099 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-fabfc7da-047a-4803-88f1-81539fd5ec99 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:02.989603 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-fabfc7da-047a-4803-88f1-81539fd5ec99 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.345751 Sep 18 00:58:02.992711 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 129/249] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:02 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:03.001466 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b8be6bd5-4081-4a2d-a50f-73f65bf0ce05 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:03.011744 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b8be6bd5-4081-4a2d-a50f-73f65bf0ce05 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.260454 Sep 18 00:58:03.027556 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 121/250] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:02 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:03.113528 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:03.114145 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:03.133984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:03.134470 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:03.134937 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:03.135728 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:03.136225 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:03.136652 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:03.289080 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:03.302998 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:03.304493 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:03.305663 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-39b20fca-545b-4e9b-9e2d-8c1da0986fa8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.196150 Sep 18 00:58:03.313195 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 130/251] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:03 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:03.467381 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3d68c70b-6687-4509-92d4-eb70471a42d3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:03.468718 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3d68c70b-6687-4509-92d4-eb70471a42d3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:03.475763 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d68c70b-6687-4509-92d4-eb70471a42d3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:03.476639 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d68c70b-6687-4509-92d4-eb70471a42d3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:03.477210 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d68c70b-6687-4509-92d4-eb70471a42d3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:03.478326 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d68c70b-6687-4509-92d4-eb70471a42d3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:03.479120 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d68c70b-6687-4509-92d4-eb70471a42d3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:03.479846 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d68c70b-6687-4509-92d4-eb70471a42d3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:03.509202 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3d68c70b-6687-4509-92d4-eb70471a42d3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/ips" status: 200 len: 149 microversion: 2.1 time: 0.048828 Sep 18 00:58:03.509883 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 122/252] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 18 00:58:03 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:58:04.018442 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c3246f43-1cff-4234-b99b-a0488b082d54 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:04.019480 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c3246f43-1cff-4234-b99b-a0488b082d54 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:04.037251 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-01241147-4eb5-42c6-9872-d691e9452bcf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:04.037966 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-01241147-4eb5-42c6-9872-d691e9452bcf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:04.042830 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c3246f43-1cff-4234-b99b-a0488b082d54 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:04.043762 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c3246f43-1cff-4234-b99b-a0488b082d54 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:04.044200 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c3246f43-1cff-4234-b99b-a0488b082d54 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:04.045003 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c3246f43-1cff-4234-b99b-a0488b082d54 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:04.048950 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c3246f43-1cff-4234-b99b-a0488b082d54 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:04.049979 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c3246f43-1cff-4234-b99b-a0488b082d54 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:04.053830 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-01241147-4eb5-42c6-9872-d691e9452bcf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:04.055575 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-01241147-4eb5-42c6-9872-d691e9452bcf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:04.057514 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-01241147-4eb5-42c6-9872-d691e9452bcf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:04.059621 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-01241147-4eb5-42c6-9872-d691e9452bcf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:04.061034 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-01241147-4eb5-42c6-9872-d691e9452bcf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:04.065173 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-01241147-4eb5-42c6-9872-d691e9452bcf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:04.334699 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c3246f43-1cff-4234-b99b-a0488b082d54 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:04.343608 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c3246f43-1cff-4234-b99b-a0488b082d54 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.330615 Sep 18 00:58:04.354392 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-01241147-4eb5-42c6-9872-d691e9452bcf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:04.359294 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 131/253] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:04 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:04.363768 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-01241147-4eb5-42c6-9872-d691e9452bcf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.330530 Sep 18 00:58:04.364774 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 123/254] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:04 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:04.367231 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:04.367874 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:04.375269 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:04.375759 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:04.376196 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:04.376894 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:04.377351 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:04.377780 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:04.548537 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:04.552538 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:04.558988 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:04.560652 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:04.562271 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3d413eb0-28bf-460b-9ffa-e5db75e9b630 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.201694 Sep 18 00:58:04.563455 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 132/255] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:04 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:05.063627 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-00f42fa9-0fda-4cef-aee6-a7cc60c35403 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4e26bcf-e563-4680-a110-a4144a0272d5"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:05.066045 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-00f42fa9-0fda-4cef-aee6-a7cc60c35403 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:05.072465 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-00f42fa9-0fda-4cef-aee6-a7cc60c35403 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:05.072950 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-00f42fa9-0fda-4cef-aee6-a7cc60c35403 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:05.073386 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-00f42fa9-0fda-4cef-aee6-a7cc60c35403 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:05.074081 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-00f42fa9-0fda-4cef-aee6-a7cc60c35403 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:05.074545 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-00f42fa9-0fda-4cef-aee6-a7cc60c35403 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:05.075010 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-00f42fa9-0fda-4cef-aee6-a7cc60c35403 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:05.376600 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-bebb0ca0-e958-4fdb-b051-6bc979d149ca tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:05.378003 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-bebb0ca0-e958-4fdb-b051-6bc979d149ca tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:05.398443 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bebb0ca0-e958-4fdb-b051-6bc979d149ca tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:05.400323 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bebb0ca0-e958-4fdb-b051-6bc979d149ca tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:05.401070 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bebb0ca0-e958-4fdb-b051-6bc979d149ca tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:05.401951 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bebb0ca0-e958-4fdb-b051-6bc979d149ca tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:05.402576 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bebb0ca0-e958-4fdb-b051-6bc979d149ca tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:05.403565 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bebb0ca0-e958-4fdb-b051-6bc979d149ca tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:05.525756 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-00f42fa9-0fda-4cef-aee6-a7cc60c35403 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466552 Sep 18 00:58:05.534664 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 124/256] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 00:58:05 2022] POST /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:05.540920 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-bf95cef7-7813-4758-92f1-c1f31dde3e5f tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:05.541859 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-bf95cef7-7813-4758-92f1-c1f31dde3e5f tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:05.550979 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf95cef7-7813-4758-92f1-c1f31dde3e5f tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:05.551686 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf95cef7-7813-4758-92f1-c1f31dde3e5f tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:05.552296 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf95cef7-7813-4758-92f1-c1f31dde3e5f tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:05.553213 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf95cef7-7813-4758-92f1-c1f31dde3e5f tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:05.553701 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf95cef7-7813-4758-92f1-c1f31dde3e5f tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:05.554369 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf95cef7-7813-4758-92f1-c1f31dde3e5f tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:05.605006 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-bebb0ca0-e958-4fdb-b051-6bc979d149ca tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:05.614184 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-bebb0ca0-e958-4fdb-b051-6bc979d149ca tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.243677 Sep 18 00:58:05.619194 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 133/257] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:05 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:05.646555 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:05.647202 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:05.649555 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:05.659004 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:05.659594 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:05.660141 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:05.661021 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:05.661699 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:05.662523 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:05.805789 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-bf95cef7-7813-4758-92f1-c1f31dde3e5f tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:05.817549 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-bf95cef7-7813-4758-92f1-c1f31dde3e5f tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.286667 Sep 18 00:58:05.822195 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 125/258] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:05 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:05.879251 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:05.887679 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:05.890318 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:05.891614 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e5a9ed54-0a56-454b-9b9c-587b4ea03b3b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.255804 Sep 18 00:58:05.892182 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 134/259] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:05 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:06.647576 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-79e1ab9d-f150-4ddf-857c-bc22e45e66c7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:06.648254 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-79e1ab9d-f150-4ddf-857c-bc22e45e66c7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:06.658503 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-79e1ab9d-f150-4ddf-857c-bc22e45e66c7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:06.658696 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-79e1ab9d-f150-4ddf-857c-bc22e45e66c7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:06.663193 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-79e1ab9d-f150-4ddf-857c-bc22e45e66c7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:06.664486 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-79e1ab9d-f150-4ddf-857c-bc22e45e66c7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:06.664999 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-79e1ab9d-f150-4ddf-857c-bc22e45e66c7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:06.665817 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-79e1ab9d-f150-4ddf-857c-bc22e45e66c7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:06.849942 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-58b85a9d-a2c8-44ec-8a9b-cf5a9f92c094 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:06.851578 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-58b85a9d-a2c8-44ec-8a9b-cf5a9f92c094 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:06.860980 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-58b85a9d-a2c8-44ec-8a9b-cf5a9f92c094 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:06.861831 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-58b85a9d-a2c8-44ec-8a9b-cf5a9f92c094 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:06.862521 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-58b85a9d-a2c8-44ec-8a9b-cf5a9f92c094 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:06.869168 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-58b85a9d-a2c8-44ec-8a9b-cf5a9f92c094 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:06.869895 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-58b85a9d-a2c8-44ec-8a9b-cf5a9f92c094 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:06.870354 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-58b85a9d-a2c8-44ec-8a9b-cf5a9f92c094 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:06.948080 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-79e1ab9d-f150-4ddf-857c-bc22e45e66c7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:06.959394 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-79e1ab9d-f150-4ddf-857c-bc22e45e66c7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.321009 Sep 18 00:58:06.966251 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 126/260] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:06 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:06.972911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:06.976814 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:07.002738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:07.004761 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:07.008191 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:07.010710 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:07.012811 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:07.015516 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:07.216198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-58b85a9d-a2c8-44ec-8a9b-cf5a9f92c094 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:07.226491 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-58b85a9d-a2c8-44ec-8a9b-cf5a9f92c094 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.380521 Sep 18 00:58:07.227127 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 135/261] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:06 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:07.240523 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:07.252989 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:07.255003 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:07.256400 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5a1ded75-db50-463f-b885-dc72c03e3b66 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.288795 Sep 18 00:58:07.257036 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 127/262] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:06 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:07.870185 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f16a281b-2bbd-43eb-b402-8b65412fdfbc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: .version_select at 0x7f5672c72d30>, body: {"keypair": {"name": "tempest-keypair-1954630842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8xLhMdP3sPrpJtXko4bW2H3ZHM2zX9iuiXNezZkmw5n/TXjK3Q5+aK2q29+/L+b5wGDWd5xfp79n67dXjDB4Tm4Wq+6IyfbGI+iLCWXMwl2xDqcqjyLdG/u4JKYPi5xA=="}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:07.887346 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-f16a281b-2bbd-43eb-b402-8b65412fdfbc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'key_pairs'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:58:07.892381 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-f16a281b-2bbd-43eb-b402-8b65412fdfbc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for user f19ac9f3986640ae9b7993b98dd403c0 and project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'key_pairs'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:58:07.917088 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f16a281b-2bbd-43eb-b402-8b65412fdfbc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050756 Sep 18 00:58:07.917692 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 136/263] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 18 00:58:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:07.995184 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-33af5760-a673-4660-bc80-66994a5880bb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:07.997600 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-33af5760-a673-4660-bc80-66994a5880bb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:08.010703 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-33af5760-a673-4660-bc80-66994a5880bb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:08.011255 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-33af5760-a673-4660-bc80-66994a5880bb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:08.011699 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-33af5760-a673-4660-bc80-66994a5880bb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:08.012416 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-33af5760-a673-4660-bc80-66994a5880bb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:08.012877 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-33af5760-a673-4660-bc80-66994a5880bb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:08.013325 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-33af5760-a673-4660-bc80-66994a5880bb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:08.252930 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-6d4bd0e0-bc75-4967-8f0d-5d52f29c71e2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:08.253839 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6d4bd0e0-bc75-4967-8f0d-5d52f29c71e2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:08.262460 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d4bd0e0-bc75-4967-8f0d-5d52f29c71e2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:08.263243 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d4bd0e0-bc75-4967-8f0d-5d52f29c71e2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:08.265303 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d4bd0e0-bc75-4967-8f0d-5d52f29c71e2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:08.266243 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d4bd0e0-bc75-4967-8f0d-5d52f29c71e2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:08.266937 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d4bd0e0-bc75-4967-8f0d-5d52f29c71e2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:08.267554 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6d4bd0e0-bc75-4967-8f0d-5d52f29c71e2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:08.359436 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-33af5760-a673-4660-bc80-66994a5880bb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:08.370124 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-33af5760-a673-4660-bc80-66994a5880bb tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.380585 Sep 18 00:58:08.378045 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 128/264] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:07 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:08.398933 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:08.400076 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:08.415809 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:08.416588 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:08.417027 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:08.417937 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:08.418376 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:08.419452 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:08.713494 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6d4bd0e0-bc75-4967-8f0d-5d52f29c71e2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:08.726920 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-6d4bd0e0-bc75-4967-8f0d-5d52f29c71e2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.475091 Sep 18 00:58:08.743264 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 137/265] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:08 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:08.782983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:08.803722 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:08.805856 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:08.807282 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-24a5e72e-0e94-4c62-a48c-38ae7fccdfe1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.427761 Sep 18 00:58:08.808296 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 129/266] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:08 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:09.405118 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-af15ba48-c9c5-4b1d-828a-12f1837a60ef tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:09.406565 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-af15ba48-c9c5-4b1d-828a-12f1837a60ef tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:09.417197 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af15ba48-c9c5-4b1d-828a-12f1837a60ef tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:09.417557 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af15ba48-c9c5-4b1d-828a-12f1837a60ef tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:09.418001 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af15ba48-c9c5-4b1d-828a-12f1837a60ef tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:09.418715 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af15ba48-c9c5-4b1d-828a-12f1837a60ef tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:09.419359 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af15ba48-c9c5-4b1d-828a-12f1837a60ef tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:09.420045 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af15ba48-c9c5-4b1d-828a-12f1837a60ef tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:09.593499 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-af15ba48-c9c5-4b1d-828a-12f1837a60ef tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:09.606146 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-af15ba48-c9c5-4b1d-828a-12f1837a60ef tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.205284 Sep 18 00:58:09.625421 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 138/267] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:09 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:09.752590 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-12b42ddd-7f8f-4aab-b009-5968de8ddfbf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:09.753488 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-12b42ddd-7f8f-4aab-b009-5968de8ddfbf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:09.767638 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-12b42ddd-7f8f-4aab-b009-5968de8ddfbf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:09.778702 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-12b42ddd-7f8f-4aab-b009-5968de8ddfbf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:09.779390 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-12b42ddd-7f8f-4aab-b009-5968de8ddfbf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:09.780177 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-12b42ddd-7f8f-4aab-b009-5968de8ddfbf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:09.780643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-12b42ddd-7f8f-4aab-b009-5968de8ddfbf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:09.781239 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-12b42ddd-7f8f-4aab-b009-5968de8ddfbf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:09.837444 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:09.838561 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:09.850139 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:09.854179 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:09.856678 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:09.858401 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:09.863701 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:09.865730 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:09.980188 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-12b42ddd-7f8f-4aab-b009-5968de8ddfbf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:09.992914 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-12b42ddd-7f8f-4aab-b009-5968de8ddfbf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.246828 Sep 18 00:58:09.999984 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 130/268] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:09 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:10.214033 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:10.231327 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:10.232701 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:10.236910 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-dc4f3715-2d5a-4484-a9ab-8f36307bcdc1 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.402532 Sep 18 00:58:10.237667 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 139/269] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:09 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:10.598669 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-927226427", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eee7c814-dc91-4de0-b55e-0732fcd7c9de"}], "security_groups": [{"name": "tempest-securitygroup--1055687421"}], "key_name": "tempest-keypair-1954630842", "user_data": "}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:10.633882 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3532f0a6-b5f7-4b87-bec9-7d4111bbbcf4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:10.634491 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3532f0a6-b5f7-4b87-bec9-7d4111bbbcf4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:10.648089 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3532f0a6-b5f7-4b87-bec9-7d4111bbbcf4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:10.648583 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3532f0a6-b5f7-4b87-bec9-7d4111bbbcf4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:10.649022 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3532f0a6-b5f7-4b87-bec9-7d4111bbbcf4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:10.649729 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3532f0a6-b5f7-4b87-bec9-7d4111bbbcf4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:10.650185 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3532f0a6-b5f7-4b87-bec9-7d4111bbbcf4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:10.650613 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3532f0a6-b5f7-4b87-bec9-7d4111bbbcf4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:11.022232 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3532f0a6-b5f7-4b87-bec9-7d4111bbbcf4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:11.044999 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3532f0a6-b5f7-4b87-bec9-7d4111bbbcf4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1724 microversion: 2.1 time: 0.412834 Sep 18 00:58:11.046386 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 140/270] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:10 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1724 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:11.058370 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] validate_networks() for [('eee7c814-dc91-4de0-b55e-0732fcd7c9de', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:58:11.066526 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e04614d7-3c24-4494-8354-211dfab336cb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:11.067376 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e04614d7-3c24-4494-8354-211dfab336cb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:11.075047 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e04614d7-3c24-4494-8354-211dfab336cb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:11.076007 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e04614d7-3c24-4494-8354-211dfab336cb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:11.078008 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e04614d7-3c24-4494-8354-211dfab336cb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:11.079619 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e04614d7-3c24-4494-8354-211dfab336cb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:11.080492 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e04614d7-3c24-4494-8354-211dfab336cb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:11.081214 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e04614d7-3c24-4494-8354-211dfab336cb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:11.367246 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e04614d7-3c24-4494-8354-211dfab336cb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:11.377446 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e04614d7-3c24-4494-8354-211dfab336cb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1502 microversion: 2.1 time: 0.327921 Sep 18 00:58:11.380533 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 141/271] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:11 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1502 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:11.394818 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:11.395734 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:11.404049 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:11.405406 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:11.406210 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:11.407324 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:11.408072 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:11.408737 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:11.816695 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:11.829835 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:11.833781 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:11.835216 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9ab4913d-7878-4fcc-817c-38b353c9ff63 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.444900 Sep 18 00:58:11.835959 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 142/272] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:11 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:11.861740 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebd6e194-d0aa-4b90-b07c-16dcbd23c74b"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:11.867038 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:11.877425 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:11.879025 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:11.880109 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:11.881708 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:11.882819 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:11.883895 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:11.915149 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:58:11.916046 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:58:11.916704 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:58:11.917128 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:58:11.917544 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:58:11.928753 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:11.929251 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:11.929689 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:11.930427 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:11.930922 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:11.931352 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:11.939586 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] HTTP exception thrown: Cannot 'attach_volume' instance bf75d794-7c36-40e0-a103-db749b9dd1e2 while it is in vm_state rescued Sep 18 00:58:11.942629 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Request method failure captured: Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: POST /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2/os-volume_attachments HTTP/1.1 Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 74 Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmy31mVmknuEEFVFaU-1XS-k0H1_yKxD0sx28JFsSSlFMJsEGR28zy2XJpRMQQN1x9OLqPLv25JxF5nxicUtHMc-A7k80RvI3QkvK9qwQ0XmK7UZaXL5gu4ruu-xgYOgeYvpm0dpbuXBtjB2YPKKLVqNnntObPsdpKJX6vJQT6ziakM Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 8cbf74b218c04911bb921f7cc2c6e966 Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:58:11.943321 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8cbf74b218c04911bb921f7cc2c6e966"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8cbf74b218c04911bb921f7cc2c6e966"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8cbf74b218c04911bb921f7cc2c6e966", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8cbf74b218c04911bb921f7cc2c6e966"}]}] Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 8cbf74b218c04911bb921f7cc2c6e966 Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-ServerRescueNegativeTestJSON-233879556-project Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 4d84f31e15924d3c8dbd7aac8a0f3576 Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-ServerRescueNegativeTestJSON-233879556-project Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: {"volumeAttachment": {"volumeId": "ebd6e194-d0aa-4b90-b07c-16dcbd23c74b"}} Sep 18 00:58:11.945548 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Cannot 'attach_volume' instance bf75d794-7c36-40e0-a103-db749b9dd1e2 while it is in vm_state rescued Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'server_id': 'bf75d794-7c36-40e0-a103-db749b9dd1e2', 'body': {'volumeAttachment': {'volumeId': 'ebd6e194-d0aa-4b90-b07c-16dcbd23c74b'}}} Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf75d794-7c36-40e0-a103-db749b9dd1e2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:58:11.946917 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bf75d794-7c36-40e0-a103-db749b9dd1e2 while it is in vm_state rescued Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:58:11.948769 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:58:11.953720 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:58:11.953720 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:58:11.953720 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bf75d794-7c36-40e0-a103-db749b9dd1e2 while it is in vm_state rescued Sep 18 00:58:11.953720 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:58:11.956959 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Returning 409 to user: Cannot 'attach_volume' instance bf75d794-7c36-40e0-a103-db749b9dd1e2 while it is in vm_state rescued {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:58:11.958853 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:58:11.959271 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-73d4deb7-061b-43a2-a134-37892db61dba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "POST /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.121578 Sep 18 00:58:11.961017 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 143/273] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 00:58:11 2022] POST /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2/os-volume_attachments => generated 152 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 00:58:11.969004 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for user f19ac9f3986640ae9b7993b98dd403c0 and project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:58:11.971143 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0ee74782-045a-45e9-aad4-028da149af9e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:11.971706 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0ee74782-045a-45e9-aad4-028da149af9e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:11.978914 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0ee74782-045a-45e9-aad4-028da149af9e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:11.979510 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0ee74782-045a-45e9-aad4-028da149af9e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:11.979962 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0ee74782-045a-45e9-aad4-028da149af9e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:11.980676 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0ee74782-045a-45e9-aad4-028da149af9e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:11.981140 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0ee74782-045a-45e9-aad4-028da149af9e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:11.981571 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0ee74782-045a-45e9-aad4-028da149af9e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:11.995041 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:58:12.001646 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:58:12.104589 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0d15405a-2747-4399-92ed-4c26e3c178e2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.510206 Sep 18 00:58:12.113033 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 131/274] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:58:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:58:12.114852 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0ee74782-045a-45e9-aad4-028da149af9e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "POST /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2/action" status: 202 len: 0 microversion: 2.1 time: 0.148528 Sep 18 00:58:12.116284 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 144/275] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 00:58:11 2022] POST /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 00:58:12.121840 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b0c07a9a-1eae-43e5-8bbf-c90b6f75e968 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:12.122310 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f0e09413-3dde-4198-bcda-bd803d8728d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:12.122828 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b0c07a9a-1eae-43e5-8bbf-c90b6f75e968 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:12.123354 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f0e09413-3dde-4198-bcda-bd803d8728d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:12.139920 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0c07a9a-1eae-43e5-8bbf-c90b6f75e968 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:12.142282 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0c07a9a-1eae-43e5-8bbf-c90b6f75e968 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:12.143484 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0c07a9a-1eae-43e5-8bbf-c90b6f75e968 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:12.145671 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0c07a9a-1eae-43e5-8bbf-c90b6f75e968 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:12.146397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0c07a9a-1eae-43e5-8bbf-c90b6f75e968 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:12.147960 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b0c07a9a-1eae-43e5-8bbf-c90b6f75e968 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:12.340758 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f0e09413-3dde-4198-bcda-bd803d8728d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:12.348831 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f0e09413-3dde-4198-bcda-bd803d8728d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1241 microversion: 2.1 time: 0.231142 Sep 18 00:58:12.363428 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 145/276] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:12 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1241 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:12.372128 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9e7236ca-6825-45fe-b6cd-5ff176b78c20 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:12.373295 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9e7236ca-6825-45fe-b6cd-5ff176b78c20 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:12.381476 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9e7236ca-6825-45fe-b6cd-5ff176b78c20 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:12.382202 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9e7236ca-6825-45fe-b6cd-5ff176b78c20 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:12.382898 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9e7236ca-6825-45fe-b6cd-5ff176b78c20 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:12.384473 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9e7236ca-6825-45fe-b6cd-5ff176b78c20 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:12.385198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9e7236ca-6825-45fe-b6cd-5ff176b78c20 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:12.385834 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9e7236ca-6825-45fe-b6cd-5ff176b78c20 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:12.864478 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b0c07a9a-1eae-43e5-8bbf-c90b6f75e968 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:12.889458 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b0c07a9a-1eae-43e5-8bbf-c90b6f75e968 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1701 microversion: 2.1 time: 0.777586 Sep 18 00:58:12.913378 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 132/277] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:12 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1701 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:12.942208 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:12.942932 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:12.970628 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:12.972895 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:12.973361 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:12.976517 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:12.979397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:12.979847 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:13.320842 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9e7236ca-6825-45fe-b6cd-5ff176b78c20 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:13.329392 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9e7236ca-6825-45fe-b6cd-5ff176b78c20 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1510 microversion: 2.1 time: 0.964560 Sep 18 00:58:13.329975 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 146/278] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:12 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1510 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:13.344603 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b0706e02-c9ca-4aa9-a098-994fb0c0e192 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:13.370288 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b0706e02-c9ca-4aa9-a098-994fb0c0e192 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:13.372316 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b0706e02-c9ca-4aa9-a098-994fb0c0e192 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:13.372773 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b0706e02-c9ca-4aa9-a098-994fb0c0e192 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:13.426930 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b0706e02-c9ca-4aa9-a098-994fb0c0e192 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Going to try to start instance {{(pid=120686) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 18 00:58:13.517095 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b0706e02-c9ca-4aa9-a098-994fb0c0e192 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "POST /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/action" status: 202 len: 0 microversion: 2.1 time: 0.185894 Sep 18 00:58:13.517770 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 147/279] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 00:58:13 2022] POST /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 00:58:13.528501 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fde4e23d-3600-448e-8f6e-7ee8811e48f4 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:13.529190 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-fde4e23d-3600-448e-8f6e-7ee8811e48f4 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:13.546271 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fde4e23d-3600-448e-8f6e-7ee8811e48f4 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:13.546931 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fde4e23d-3600-448e-8f6e-7ee8811e48f4 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:13.547512 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fde4e23d-3600-448e-8f6e-7ee8811e48f4 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:13.548215 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fde4e23d-3600-448e-8f6e-7ee8811e48f4 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:13.553389 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fde4e23d-3600-448e-8f6e-7ee8811e48f4 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:13.553818 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fde4e23d-3600-448e-8f6e-7ee8811e48f4 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:13.672629 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:13.720585 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:13.722879 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:13.736351 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-ad5f9775-5cba-4e45-89b2-677ae7635ab4 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.819857 Sep 18 00:58:13.737183 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 133/280] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:12 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:13.762600 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-fde4e23d-3600-448e-8f6e-7ee8811e48f4 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:13.796923 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-fde4e23d-3600-448e-8f6e-7ee8811e48f4 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1293 microversion: 2.1 time: 0.269650 Sep 18 00:58:13.797165 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-bf347831-d747-41a7-a921-8ef05eb0eda8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:13.798011 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 148/281] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:13 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1293 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:13.818369 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-bf347831-d747-41a7-a921-8ef05eb0eda8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:13.851351 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf347831-d747-41a7-a921-8ef05eb0eda8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:13.852179 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf347831-d747-41a7-a921-8ef05eb0eda8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:13.857099 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf347831-d747-41a7-a921-8ef05eb0eda8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:13.858551 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf347831-d747-41a7-a921-8ef05eb0eda8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:13.863450 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf347831-d747-41a7-a921-8ef05eb0eda8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:13.865536 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bf347831-d747-41a7-a921-8ef05eb0eda8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:14.328536 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-bf347831-d747-41a7-a921-8ef05eb0eda8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:14.344890 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-bf347831-d747-41a7-a921-8ef05eb0eda8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1710 microversion: 2.1 time: 0.572390 Sep 18 00:58:14.346167 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 134/282] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:13 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1710 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:14.354217 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c80d605e-22ef-47ed-b636-cb0df933ff10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:14.354899 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c80d605e-22ef-47ed-b636-cb0df933ff10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:14.362282 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c80d605e-22ef-47ed-b636-cb0df933ff10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:14.362840 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c80d605e-22ef-47ed-b636-cb0df933ff10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:14.363315 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c80d605e-22ef-47ed-b636-cb0df933ff10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:14.364061 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c80d605e-22ef-47ed-b636-cb0df933ff10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:14.364558 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c80d605e-22ef-47ed-b636-cb0df933ff10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:14.365026 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c80d605e-22ef-47ed-b636-cb0df933ff10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:14.593859 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c80d605e-22ef-47ed-b636-cb0df933ff10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:14.600375 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:14.603188 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c80d605e-22ef-47ed-b636-cb0df933ff10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1510 microversion: 2.1 time: 0.252701 Sep 18 00:58:14.604259 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 149/283] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:14 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:14.772979 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:14.774489 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:14.784805 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:14.793305 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:14.796312 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:14.799537 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:14.802411 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:14.803490 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:14.833164 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-cf04e04e-38c1-45a7-a8a5-797091d7086e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:14.834055 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-cf04e04e-38c1-45a7-a8a5-797091d7086e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:14.846646 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf04e04e-38c1-45a7-a8a5-797091d7086e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:14.847413 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf04e04e-38c1-45a7-a8a5-797091d7086e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:14.848168 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf04e04e-38c1-45a7-a8a5-797091d7086e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:14.849168 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf04e04e-38c1-45a7-a8a5-797091d7086e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:14.851727 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf04e04e-38c1-45a7-a8a5-797091d7086e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:14.852462 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf04e04e-38c1-45a7-a8a5-797091d7086e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:15.032242 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-cf04e04e-38c1-45a7-a8a5-797091d7086e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:15.077805 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-cf04e04e-38c1-45a7-a8a5-797091d7086e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1301 microversion: 2.1 time: 0.248266 Sep 18 00:58:15.101370 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 150/284] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:14 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1301 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:15.163343 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:15.186341 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:15.192724 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:15.193938 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-25edc153-5b5d-4859-997b-ecb26883e87a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.425666 Sep 18 00:58:15.196374 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 135/285] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:14 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:15.371935 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-883f08f9-172a-4098-820e-92488af8b53b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:15.372825 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-883f08f9-172a-4098-820e-92488af8b53b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:15.381759 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-883f08f9-172a-4098-820e-92488af8b53b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:15.382561 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-883f08f9-172a-4098-820e-92488af8b53b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:15.384931 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-883f08f9-172a-4098-820e-92488af8b53b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:15.385819 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-883f08f9-172a-4098-820e-92488af8b53b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:15.386445 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-883f08f9-172a-4098-820e-92488af8b53b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:15.387063 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-883f08f9-172a-4098-820e-92488af8b53b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:15.594345 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-883f08f9-172a-4098-820e-92488af8b53b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:15.607889 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-883f08f9-172a-4098-820e-92488af8b53b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1710 microversion: 2.1 time: 0.239609 Sep 18 00:58:15.609354 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 151/286] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:15 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1710 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:15.635783 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b9732615-1314-4238-9d56-8d78648ac480 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:15.636966 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b9732615-1314-4238-9d56-8d78648ac480 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:15.644550 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b9732615-1314-4238-9d56-8d78648ac480 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:15.645254 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b9732615-1314-4238-9d56-8d78648ac480 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:15.645883 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b9732615-1314-4238-9d56-8d78648ac480 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:15.646845 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b9732615-1314-4238-9d56-8d78648ac480 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:15.647489 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b9732615-1314-4238-9d56-8d78648ac480 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:15.648132 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b9732615-1314-4238-9d56-8d78648ac480 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:15.884989 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b9732615-1314-4238-9d56-8d78648ac480 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:15.894396 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b9732615-1314-4238-9d56-8d78648ac480 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1510 microversion: 2.1 time: 0.262393 Sep 18 00:58:15.897248 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 136/287] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:15 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:16.117002 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-af9b8403-9715-428b-9550-c20c47f881d1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:16.117626 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-af9b8403-9715-428b-9550-c20c47f881d1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:16.125103 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af9b8403-9715-428b-9550-c20c47f881d1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:16.125601 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af9b8403-9715-428b-9550-c20c47f881d1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:16.126233 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af9b8403-9715-428b-9550-c20c47f881d1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:16.126984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af9b8403-9715-428b-9550-c20c47f881d1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:16.127452 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af9b8403-9715-428b-9550-c20c47f881d1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:16.128145 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-af9b8403-9715-428b-9550-c20c47f881d1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:16.228201 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:16.229419 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:16.253558 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:16.260200 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:16.261531 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:16.262570 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:16.263400 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:16.266069 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:16.274507 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-af9b8403-9715-428b-9550-c20c47f881d1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:16.296564 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-af9b8403-9715-428b-9550-c20c47f881d1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1311 microversion: 2.1 time: 0.183347 Sep 18 00:58:16.314878 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 152/288] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:16 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1311 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:16.468397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:16.476729 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:16.478185 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:16.479382 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-255c7c71-74bd-42e5-918e-245b9e128ce8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.257147 Sep 18 00:58:16.479932 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 137/289] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:16 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:16.637248 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d49ba5fc-c94b-4723-b297-fcb24f51682c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:16.639005 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d49ba5fc-c94b-4723-b297-fcb24f51682c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:16.648793 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d49ba5fc-c94b-4723-b297-fcb24f51682c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:16.650144 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d49ba5fc-c94b-4723-b297-fcb24f51682c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:16.650712 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d49ba5fc-c94b-4723-b297-fcb24f51682c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:16.653009 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d49ba5fc-c94b-4723-b297-fcb24f51682c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:16.654002 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d49ba5fc-c94b-4723-b297-fcb24f51682c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:16.654601 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d49ba5fc-c94b-4723-b297-fcb24f51682c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:16.837463 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d49ba5fc-c94b-4723-b297-fcb24f51682c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:16.846064 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d49ba5fc-c94b-4723-b297-fcb24f51682c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1710 microversion: 2.1 time: 0.216676 Sep 18 00:58:16.847612 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 153/290] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:16 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1710 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:16.945502 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a116315b-5814-4e96-b4a6-b9ac527acb9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:16.945502 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a116315b-5814-4e96-b4a6-b9ac527acb9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:16.963391 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a116315b-5814-4e96-b4a6-b9ac527acb9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:16.964431 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a116315b-5814-4e96-b4a6-b9ac527acb9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:16.965216 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a116315b-5814-4e96-b4a6-b9ac527acb9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:16.970929 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a116315b-5814-4e96-b4a6-b9ac527acb9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:16.972009 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a116315b-5814-4e96-b4a6-b9ac527acb9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:16.972744 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a116315b-5814-4e96-b4a6-b9ac527acb9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:17.203084 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a116315b-5814-4e96-b4a6-b9ac527acb9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:17.214416 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a116315b-5814-4e96-b4a6-b9ac527acb9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1516 microversion: 2.1 time: 0.295645 Sep 18 00:58:17.223688 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 138/291] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:16 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1516 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:17.325060 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-295724394", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "networks": [{"uuid": "fd165d05-651e-4c2d-9094-a51f056f104b"}]}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:17.343521 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d8eb8af1-bd57-45aa-8571-e40a6dcd010d tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:17.344762 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d8eb8af1-bd57-45aa-8571-e40a6dcd010d tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:17.358772 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8eb8af1-bd57-45aa-8571-e40a6dcd010d tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:17.359656 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8eb8af1-bd57-45aa-8571-e40a6dcd010d tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:17.360097 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8eb8af1-bd57-45aa-8571-e40a6dcd010d tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:17.360817 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8eb8af1-bd57-45aa-8571-e40a6dcd010d tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:17.361274 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8eb8af1-bd57-45aa-8571-e40a6dcd010d tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:17.361700 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8eb8af1-bd57-45aa-8571-e40a6dcd010d tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:17.463772 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.network.neutron [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] validate_networks() for [('fd165d05-651e-4c2d-9094-a51f056f104b', None, None, None, None, None)] {{(pid=120686) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:58:17.482547 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d8eb8af1-bd57-45aa-8571-e40a6dcd010d tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:17.493067 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d8eb8af1-bd57-45aa-8571-e40a6dcd010d tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1299 microversion: 2.1 time: 0.154496 Sep 18 00:58:17.495335 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 139/292] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:17 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:17.515890 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:17.516969 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:17.527877 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:17.530871 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:17.531577 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:17.532501 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:17.533184 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:17.533835 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:17.878823 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:17.894508 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:17.896152 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:17.897348 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1228cf43-2878-41a4-9039-d7506a9fceb0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.394580 Sep 18 00:58:17.899578 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 140/293] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:17 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:17.908374 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a2b242ae-5219-44ac-85e4-75c7961643c0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:17.908997 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a2b242ae-5219-44ac-85e4-75c7961643c0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:17.918763 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a2b242ae-5219-44ac-85e4-75c7961643c0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:17.919473 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a2b242ae-5219-44ac-85e4-75c7961643c0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:17.920822 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a2b242ae-5219-44ac-85e4-75c7961643c0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:17.922125 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a2b242ae-5219-44ac-85e4-75c7961643c0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:17.922913 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a2b242ae-5219-44ac-85e4-75c7961643c0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:17.923494 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a2b242ae-5219-44ac-85e4-75c7961643c0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:18.200439 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a2b242ae-5219-44ac-85e4-75c7961643c0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:18.219734 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a2b242ae-5219-44ac-85e4-75c7961643c0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1710 microversion: 2.1 time: 0.320444 Sep 18 00:58:18.220329 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 141/294] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:17 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1710 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:18.250905 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Flavor limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:58:18.251982 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Image limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:58:18.252926 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Flavor pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:58:18.253983 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Image pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:58:18.254702 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:58:18.266895 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:18.267714 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:18.288146 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:18.290762 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:18.291310 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:18.293329 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:18.315789 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Getting quotas for project a5eba1f622574f5cacecaccdba833801. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:58:18.320015 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Getting quotas for user d23f9e763a994566bddd9508a79cce54 and project a5eba1f622574f5cacecaccdba833801. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:58:18.331729 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Going to run 1 instances... {{(pid=120686) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:58:18.334023 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:58:18.379201 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-12711444-b01e-4ce7-8b33-cea327f0b6d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.058531 Sep 18 00:58:18.380010 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 154/295] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:58:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:58:18.391939 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-29ee1758-dce5-4cd8-9ca6-30a9c624dd6b tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:18.392826 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-29ee1758-dce5-4cd8-9ca6-30a9c624dd6b tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:18.464197 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-29ee1758-dce5-4cd8-9ca6-30a9c624dd6b tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:18.474574 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-29ee1758-dce5-4cd8-9ca6-30a9c624dd6b tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1218 microversion: 2.1 time: 0.086739 Sep 18 00:58:18.475792 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 142/296] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:18 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:18.521909 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2b24032f-d2f8-44f0-8aa4-bf04ed8d9c3e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:18.522522 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-2b24032f-d2f8-44f0-8aa4-bf04ed8d9c3e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:18.528906 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b24032f-d2f8-44f0-8aa4-bf04ed8d9c3e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:18.529938 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b24032f-d2f8-44f0-8aa4-bf04ed8d9c3e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:18.530372 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b24032f-d2f8-44f0-8aa4-bf04ed8d9c3e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:18.531116 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b24032f-d2f8-44f0-8aa4-bf04ed8d9c3e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:18.531579 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b24032f-d2f8-44f0-8aa4-bf04ed8d9c3e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:18.532004 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2b24032f-d2f8-44f0-8aa4-bf04ed8d9c3e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:18.788837 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2b24032f-d2f8-44f0-8aa4-bf04ed8d9c3e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:18.801716 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2b24032f-d2f8-44f0-8aa4-bf04ed8d9c3e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1367 microversion: 2.1 time: 0.284102 Sep 18 00:58:18.802193 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 155/297] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:18 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:18.830177 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3c732996-0a89-49b7-bb42-cf34d085fbb6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Action: 'create', calling method: .version_select at 0x7f5672da8940>, body: {"keypair": {"name": "tempest-keypair-1984837072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd0mMBXgyp+GKTDm/TnU+RxHGkNf0dAPoUu3ZDPTKEInJ/A8OxNXp9DeSzUA18xrSmPfQzZZEuO9mg2RhkfWrPfMGyXTJRULZod5m1r7NldffRv3YPFpUwVLqrL7rw1cA=="}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:18.874326 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-3c732996-0a89-49b7-bb42-cf34d085fbb6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Getting quotas for project 8cbf74b218c04911bb921f7cc2c6e966. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:58:18.879063 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-3c732996-0a89-49b7-bb42-cf34d085fbb6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Getting quotas for user 4d84f31e15924d3c8dbd7aac8a0f3576 and project 8cbf74b218c04911bb921f7cc2c6e966. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:58:18.926720 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:18.927462 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:18.934340 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3c732996-0a89-49b7-bb42-cf34d085fbb6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109010 Sep 18 00:58:18.934575 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:18.934982 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 143/298] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 18 00:58:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:18.949041 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:18.949627 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:18.958007 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:18.959609 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:18.961765 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:19.102130 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-620e0611-9a30-4a26-859a-296d5098bedf req-a7503da5-ae10-47d1-aff4-d153c29e471f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b142dfeb-6de9-4d35-9b1e-b0545715235b", "tag": "52a424bc-9fbd-479c-b108-af4ee47377ab"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:19.115277 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-620e0611-9a30-4a26-859a-296d5098bedf req-a7503da5-ae10-47d1-aff4-d153c29e471f service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:19.115770 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-620e0611-9a30-4a26-859a-296d5098bedf req-a7503da5-ae10-47d1-aff4-d153c29e471f service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:19.116199 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-620e0611-9a30-4a26-859a-296d5098bedf req-a7503da5-ae10-47d1-aff4-d153c29e471f service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:19.143545 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-620e0611-9a30-4a26-859a-296d5098bedf req-a7503da5-ae10-47d1-aff4-d153c29e471f service nova] Creating event network-changed:52a424bc-9fbd-479c-b108-af4ee47377ab for instance b142dfeb-6de9-4d35-9b1e-b0545715235b on hv-cinder-maste Sep 18 00:58:19.151937 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-620e0611-9a30-4a26-859a-296d5098bedf req-a7503da5-ae10-47d1-aff4-d153c29e471f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054832 Sep 18 00:58:19.153219 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 144/299] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:19.250881 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a1eb1e03-9a3d-4b69-8665-6f8ecef5f64c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:19.251555 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a1eb1e03-9a3d-4b69-8665-6f8ecef5f64c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:19.259267 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1eb1e03-9a3d-4b69-8665-6f8ecef5f64c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:19.259762 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1eb1e03-9a3d-4b69-8665-6f8ecef5f64c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:19.260193 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1eb1e03-9a3d-4b69-8665-6f8ecef5f64c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:19.260799 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:19.261254 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1eb1e03-9a3d-4b69-8665-6f8ecef5f64c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:19.261340 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1eb1e03-9a3d-4b69-8665-6f8ecef5f64c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:19.261737 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1eb1e03-9a3d-4b69-8665-6f8ecef5f64c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:19.275177 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:19.277265 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:19.284383 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-6582752a-f8d5-45af-8db3-4830a74f957a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.361492 Sep 18 00:58:19.286920 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 156/300] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:18 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:19.501314 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f3af4fd0-c3c5-450b-8713-0b6aed871837 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:19.501943 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f3af4fd0-c3c5-450b-8713-0b6aed871837 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:19.516981 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3af4fd0-c3c5-450b-8713-0b6aed871837 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:19.517408 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3af4fd0-c3c5-450b-8713-0b6aed871837 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:19.517832 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3af4fd0-c3c5-450b-8713-0b6aed871837 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:19.518554 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3af4fd0-c3c5-450b-8713-0b6aed871837 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:19.519049 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3af4fd0-c3c5-450b-8713-0b6aed871837 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:19.519484 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3af4fd0-c3c5-450b-8713-0b6aed871837 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:19.630730 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f3af4fd0-c3c5-450b-8713-0b6aed871837 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:19.643178 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f3af4fd0-c3c5-450b-8713-0b6aed871837 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1270 microversion: 2.1 time: 0.147336 Sep 18 00:58:19.647920 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a1eb1e03-9a3d-4b69-8665-6f8ecef5f64c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:19.654896 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 157/301] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:19 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:19.657159 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a1eb1e03-9a3d-4b69-8665-6f8ecef5f64c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1714 microversion: 2.1 time: 0.410585 Sep 18 00:58:19.658043 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 145/302] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:19 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1714 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:19.831064 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-5c26ad4f-3493-4eab-9806-b41cb5588557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:19.832351 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-5c26ad4f-3493-4eab-9806-b41cb5588557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:19.839603 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c26ad4f-3493-4eab-9806-b41cb5588557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:19.840094 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c26ad4f-3493-4eab-9806-b41cb5588557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:19.840916 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c26ad4f-3493-4eab-9806-b41cb5588557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:19.842381 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c26ad4f-3493-4eab-9806-b41cb5588557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:19.843380 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c26ad4f-3493-4eab-9806-b41cb5588557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:19.843611 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c26ad4f-3493-4eab-9806-b41cb5588557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:20.252980 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-5c26ad4f-3493-4eab-9806-b41cb5588557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:20.264175 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-5c26ad4f-3493-4eab-9806-b41cb5588557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1367 microversion: 2.1 time: 0.437180 Sep 18 00:58:20.265762 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 158/303] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:19 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:20.314750 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:20.315490 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:20.324206 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:20.324975 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:20.325423 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:20.326342 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:20.327486 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:20.328103 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:20.539438 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:20.548667 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:20.550294 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:20.551597 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8212d1eb-115a-48c3-9523-254143b0e189 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.242532 Sep 18 00:58:20.552384 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 146/304] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:20 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:20.667203 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-38936946-fef4-4a6a-b6c9-700ba2041444 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:20.667819 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-38936946-fef4-4a6a-b6c9-700ba2041444 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:20.675286 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-38936946-fef4-4a6a-b6c9-700ba2041444 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:20.675784 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-38936946-fef4-4a6a-b6c9-700ba2041444 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:20.676215 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-38936946-fef4-4a6a-b6c9-700ba2041444 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:20.677515 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-38936946-fef4-4a6a-b6c9-700ba2041444 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:20.677993 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-38936946-fef4-4a6a-b6c9-700ba2041444 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:20.678424 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-38936946-fef4-4a6a-b6c9-700ba2041444 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:20.741138 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-38936946-fef4-4a6a-b6c9-700ba2041444 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:20.749075 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-38936946-fef4-4a6a-b6c9-700ba2041444 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1276 microversion: 2.1 time: 0.085894 Sep 18 00:58:20.749651 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 159/305] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:20 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:21.258764 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1088877346", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c62b9e47-59b6-47ba-845f-e3be4dd39ad8"}], "security_groups": [{"name": "tempest-securitygroup--1860132421"}], "key_name": "tempest-keypair-1984837072", "user_data": "}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:21.288407 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-02cd79ad-40be-4514-81aa-7634c16939b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:21.289015 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-02cd79ad-40be-4514-81aa-7634c16939b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:21.298566 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-02cd79ad-40be-4514-81aa-7634c16939b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:21.299682 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-02cd79ad-40be-4514-81aa-7634c16939b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:21.300139 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-02cd79ad-40be-4514-81aa-7634c16939b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:21.300815 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-02cd79ad-40be-4514-81aa-7634c16939b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:21.301270 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-02cd79ad-40be-4514-81aa-7634c16939b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:21.301687 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-02cd79ad-40be-4514-81aa-7634c16939b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:21.661523 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] validate_networks() for [('c62b9e47-59b6-47ba-845f-e3be4dd39ad8', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:58:21.907318 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-02cd79ad-40be-4514-81aa-7634c16939b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:21.926199 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-02cd79ad-40be-4514-81aa-7634c16939b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1367 microversion: 2.1 time: 0.641493 Sep 18 00:58:21.940645 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 160/306] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:21 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1367 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:21.943710 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:21.954821 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:21.955697 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:21.979639 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:21.980377 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:21.980656 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:21.981461 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:21.983542 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:21.984002 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:22.361461 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:22.370855 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:22.372641 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:22.374396 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ef5b3722-f9be-492f-8d60-efcb88b9cb7c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1745 microversion: 2.20 time: 0.432511 Sep 18 00:58:22.375276 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 161/307] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:21 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1745 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:22.391427 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7c7322d1-3a3f-44ce-9d14-d4c21abff345 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:22.391783 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7c7322d1-3a3f-44ce-9d14-d4c21abff345 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:22.403131 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7c7322d1-3a3f-44ce-9d14-d4c21abff345 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:22.403630 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7c7322d1-3a3f-44ce-9d14-d4c21abff345 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:22.404958 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7c7322d1-3a3f-44ce-9d14-d4c21abff345 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:22.405871 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7c7322d1-3a3f-44ce-9d14-d4c21abff345 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:22.406545 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7c7322d1-3a3f-44ce-9d14-d4c21abff345 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:22.407599 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7c7322d1-3a3f-44ce-9d14-d4c21abff345 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:22.656123 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:58:22.656554 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:58:22.657031 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:58:22.657463 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:58:22.657959 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:58:22.667262 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:22.668427 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:22.669039 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:22.670375 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:22.670859 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:22.671611 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:22.696286 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Getting quotas for project 8cbf74b218c04911bb921f7cc2c6e966. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:58:22.701859 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Getting quotas for user 4d84f31e15924d3c8dbd7aac8a0f3576 and project 8cbf74b218c04911bb921f7cc2c6e966. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:58:22.718907 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:58:22.722584 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:58:22.724809 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7c7322d1-3a3f-44ce-9d14-d4c21abff345 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:22.737491 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7c7322d1-3a3f-44ce-9d14-d4c21abff345 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1318 microversion: 2.1 time: 0.355713 Sep 18 00:58:22.738030 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 162/308] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:22 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:22.739238 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:22.749931 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-1bba2739-120f-44f1-9946-30ebccc349ca req-10342399-1c05-4f6b-9181-fda262d5620a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "234a399b-97be-4b3b-8bdb-75278ffdc4e0", "tag": "41adca23-a8d9-445c-9eaa-f1623bb2425c"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:22.773030 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-1bba2739-120f-44f1-9946-30ebccc349ca req-10342399-1c05-4f6b-9181-fda262d5620a service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:22.777285 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-1bba2739-120f-44f1-9946-30ebccc349ca req-10342399-1c05-4f6b-9181-fda262d5620a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:22.777918 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-1bba2739-120f-44f1-9946-30ebccc349ca req-10342399-1c05-4f6b-9181-fda262d5620a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:22.800993 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-1bba2739-120f-44f1-9946-30ebccc349ca req-10342399-1c05-4f6b-9181-fda262d5620a service nova] Creating event network-changed:41adca23-a8d9-445c-9eaa-f1623bb2425c for instance 234a399b-97be-4b3b-8bdb-75278ffdc4e0 on hv-cinder-maste Sep 18 00:58:22.807042 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1369c263-658b-4374-a3db-1e100ffeac7b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.549529 Sep 18 00:58:22.811940 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 147/309] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:58:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:58:22.822195 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-1bba2739-120f-44f1-9946-30ebccc349ca req-10342399-1c05-4f6b-9181-fda262d5620a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082182 Sep 18 00:58:22.822623 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-013c2758-2c28-407e-acf7-f154e3de4d59 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:22.823279 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-013c2758-2c28-407e-acf7-f154e3de4d59 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:22.829148 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 163/310] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:22.921748 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-013c2758-2c28-407e-acf7-f154e3de4d59 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:22.931836 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-013c2758-2c28-407e-acf7-f154e3de4d59 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1246 microversion: 2.1 time: 0.114908 Sep 18 00:58:22.933461 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 148/311] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:22 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1246 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:22.956840 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-744e52d9-b32a-4be2-ad91-86876909c5d2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:22.957543 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-744e52d9-b32a-4be2-ad91-86876909c5d2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:22.989815 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-744e52d9-b32a-4be2-ad91-86876909c5d2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:22.992117 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-744e52d9-b32a-4be2-ad91-86876909c5d2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:22.996410 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-744e52d9-b32a-4be2-ad91-86876909c5d2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:22.997958 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-744e52d9-b32a-4be2-ad91-86876909c5d2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:22.998596 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-744e52d9-b32a-4be2-ad91-86876909c5d2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:22.999334 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-744e52d9-b32a-4be2-ad91-86876909c5d2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:23.187426 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-744e52d9-b32a-4be2-ad91-86876909c5d2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:23.198867 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-744e52d9-b32a-4be2-ad91-86876909c5d2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1367 microversion: 2.1 time: 0.245861 Sep 18 00:58:23.199950 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 164/312] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:22 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:23.402861 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:23.403506 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:23.410104 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:23.410593 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:23.411068 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:23.411768 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:23.412226 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:23.412652 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:23.551114 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:23.559859 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:23.561565 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:23.562828 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-20e04405-6e34-4209-a0ed-a45a5d45a79d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1745 microversion: 2.20 time: 0.164079 Sep 18 00:58:23.563460 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 149/313] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:23 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:23.763479 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-33d3d343-393b-47a7-9c7c-bb4b5bf3df27 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:23.764608 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-33d3d343-393b-47a7-9c7c-bb4b5bf3df27 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:23.770720 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33d3d343-393b-47a7-9c7c-bb4b5bf3df27 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:23.771249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33d3d343-393b-47a7-9c7c-bb4b5bf3df27 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:23.771699 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33d3d343-393b-47a7-9c7c-bb4b5bf3df27 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:23.772396 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33d3d343-393b-47a7-9c7c-bb4b5bf3df27 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:23.772848 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33d3d343-393b-47a7-9c7c-bb4b5bf3df27 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:23.773269 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33d3d343-393b-47a7-9c7c-bb4b5bf3df27 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:23.916668 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-33d3d343-393b-47a7-9c7c-bb4b5bf3df27 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:23.934405 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-33d3d343-393b-47a7-9c7c-bb4b5bf3df27 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1318 microversion: 2.1 time: 0.176736 Sep 18 00:58:23.935395 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 165/314] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:23 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:23.956543 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-80fb5fdf-f339-4958-9179-a67600cc0c94 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:23.957692 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-80fb5fdf-f339-4958-9179-a67600cc0c94 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:23.993445 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-80fb5fdf-f339-4958-9179-a67600cc0c94 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:23.994158 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-80fb5fdf-f339-4958-9179-a67600cc0c94 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:23.994962 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-80fb5fdf-f339-4958-9179-a67600cc0c94 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:23.995687 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-80fb5fdf-f339-4958-9179-a67600cc0c94 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:23.996147 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-80fb5fdf-f339-4958-9179-a67600cc0c94 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:23.996569 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-80fb5fdf-f339-4958-9179-a67600cc0c94 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:24.080787 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-80fb5fdf-f339-4958-9179-a67600cc0c94 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:24.088570 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-80fb5fdf-f339-4958-9179-a67600cc0c94 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1250 microversion: 2.1 time: 0.135848 Sep 18 00:58:24.089230 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 150/315] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:23 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1250 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:24.222038 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3cfd3629-5b28-47c4-aa44-026bd342ac8c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:24.222644 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3cfd3629-5b28-47c4-aa44-026bd342ac8c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:24.228527 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cfd3629-5b28-47c4-aa44-026bd342ac8c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:24.229005 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cfd3629-5b28-47c4-aa44-026bd342ac8c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:24.229437 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cfd3629-5b28-47c4-aa44-026bd342ac8c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:24.230124 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cfd3629-5b28-47c4-aa44-026bd342ac8c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:24.230572 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cfd3629-5b28-47c4-aa44-026bd342ac8c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:24.231032 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cfd3629-5b28-47c4-aa44-026bd342ac8c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:24.398679 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3cfd3629-5b28-47c4-aa44-026bd342ac8c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:24.414615 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3cfd3629-5b28-47c4-aa44-026bd342ac8c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1367 microversion: 2.1 time: 0.196203 Sep 18 00:58:24.415776 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 166/316] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:24 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:24.588241 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:24.588950 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:24.597092 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:24.597814 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:24.598313 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:24.599102 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:24.599766 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:24.600249 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:24.858105 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:24.871590 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:24.874959 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:24.876405 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a47d7152-c51b-449f-a8b1-eed598db819d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1745 microversion: 2.20 time: 0.292413 Sep 18 00:58:24.878407 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 151/317] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:24 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1745 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:58:24.959507 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0fc86b60-6dde-456b-b881-1ee517bf9f80 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:24.960879 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0fc86b60-6dde-456b-b881-1ee517bf9f80 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:24.970034 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0fc86b60-6dde-456b-b881-1ee517bf9f80 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:24.988254 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0fc86b60-6dde-456b-b881-1ee517bf9f80 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:24.988254 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0fc86b60-6dde-456b-b881-1ee517bf9f80 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:24.988254 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0fc86b60-6dde-456b-b881-1ee517bf9f80 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:24.988254 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0fc86b60-6dde-456b-b881-1ee517bf9f80 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:24.989350 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0fc86b60-6dde-456b-b881-1ee517bf9f80 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:25.121807 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7d6957aa-7488-4be7-963e-b5019f1e0215 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:25.125900 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7d6957aa-7488-4be7-963e-b5019f1e0215 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:25.160810 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d6957aa-7488-4be7-963e-b5019f1e0215 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:25.163979 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d6957aa-7488-4be7-963e-b5019f1e0215 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:25.166119 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d6957aa-7488-4be7-963e-b5019f1e0215 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:25.172994 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d6957aa-7488-4be7-963e-b5019f1e0215 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:25.173594 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d6957aa-7488-4be7-963e-b5019f1e0215 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:25.177754 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7d6957aa-7488-4be7-963e-b5019f1e0215 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:25.441945 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7d6957aa-7488-4be7-963e-b5019f1e0215 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:25.451444 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=100 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:25.455620 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7d6957aa-7488-4be7-963e-b5019f1e0215 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1298 microversion: 2.1 time: 0.347116 Sep 18 00:58:25.463118 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-0fc86b60-6dde-456b-b881-1ee517bf9f80 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:25.468253 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=100 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:25.484496 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 152/318] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:25 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1298 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:25.490546 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0fc86b60-6dde-456b-b881-1ee517bf9f80 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1318 microversion: 2.1 time: 0.536553 Sep 18 00:58:25.495600 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 167/319] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:24 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:25.500517 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-1bd877b2-3fa9-4c48-9ea5-6ac3641557ca req-5dd0e990-bd78-4572-a567-d25e09565d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cf145a-d8d5-4a7e-937b-729bf79629fa", "name": "network-vif-plugged", "status": "completed", "tag": "3b10ed6a-bc95-40e6-afaa-4936e44594eb"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:25.502938 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c8a40353-eaa4-4a7d-8bfc-53da0a553a5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:25.503929 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c8a40353-eaa4-4a7d-8bfc-53da0a553a5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:25.511736 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8a40353-eaa4-4a7d-8bfc-53da0a553a5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:25.512244 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8a40353-eaa4-4a7d-8bfc-53da0a553a5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:25.512688 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8a40353-eaa4-4a7d-8bfc-53da0a553a5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:25.513499 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8a40353-eaa4-4a7d-8bfc-53da0a553a5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:25.514146 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8a40353-eaa4-4a7d-8bfc-53da0a553a5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:25.514757 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8a40353-eaa4-4a7d-8bfc-53da0a553a5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:25.522574 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-1bd877b2-3fa9-4c48-9ea5-6ac3641557ca req-5dd0e990-bd78-4572-a567-d25e09565d7c service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:25.523545 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-1bd877b2-3fa9-4c48-9ea5-6ac3641557ca req-5dd0e990-bd78-4572-a567-d25e09565d7c service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:25.524195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-1bd877b2-3fa9-4c48-9ea5-6ac3641557ca req-5dd0e990-bd78-4572-a567-d25e09565d7c service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:25.538541 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-1bd877b2-3fa9-4c48-9ea5-6ac3641557ca req-5dd0e990-bd78-4572-a567-d25e09565d7c service nova] Creating event network-vif-plugged:3b10ed6a-bc95-40e6-afaa-4936e44594eb for instance c1cf145a-d8d5-4a7e-937b-729bf79629fa on hv-cinder-maste Sep 18 00:58:25.546621 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-1bd877b2-3fa9-4c48-9ea5-6ac3641557ca req-5dd0e990-bd78-4572-a567-d25e09565d7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059183 Sep 18 00:58:25.548202 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 153/320] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:25.814537 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c8a40353-eaa4-4a7d-8bfc-53da0a553a5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:25.837883 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c8a40353-eaa4-4a7d-8bfc-53da0a553a5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1367 microversion: 2.1 time: 0.340004 Sep 18 00:58:25.839318 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 168/321] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:25 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:25.905423 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:25.906840 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:25.921926 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:25.922757 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:25.923690 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:25.924778 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:25.925492 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:25.926137 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:26.327702 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:26.341914 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:26.343506 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:26.344864 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-40956d56-34ff-4322-910e-74d5481f571f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.446024 Sep 18 00:58:26.355378 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 154/322] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:25 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:26.482161 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a03eba87-85b2-4fca-b7f8-9915e1f62fdb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:26.483043 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-a03eba87-85b2-4fca-b7f8-9915e1f62fdb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:26.493214 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a03eba87-85b2-4fca-b7f8-9915e1f62fdb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:26.493945 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a03eba87-85b2-4fca-b7f8-9915e1f62fdb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:26.494570 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a03eba87-85b2-4fca-b7f8-9915e1f62fdb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:26.495478 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a03eba87-85b2-4fca-b7f8-9915e1f62fdb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:26.496094 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a03eba87-85b2-4fca-b7f8-9915e1f62fdb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:26.497017 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a03eba87-85b2-4fca-b7f8-9915e1f62fdb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:26.522260 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d05560e0-3459-4bd1-8077-1f40fbbdd978 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:26.523445 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d05560e0-3459-4bd1-8077-1f40fbbdd978 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:26.540456 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d05560e0-3459-4bd1-8077-1f40fbbdd978 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:26.541740 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d05560e0-3459-4bd1-8077-1f40fbbdd978 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:26.543467 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d05560e0-3459-4bd1-8077-1f40fbbdd978 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:26.549557 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d05560e0-3459-4bd1-8077-1f40fbbdd978 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:26.550051 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d05560e0-3459-4bd1-8077-1f40fbbdd978 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:26.550502 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d05560e0-3459-4bd1-8077-1f40fbbdd978 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:26.598863 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a03eba87-85b2-4fca-b7f8-9915e1f62fdb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:26.615115 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a03eba87-85b2-4fca-b7f8-9915e1f62fdb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1304 microversion: 2.1 time: 0.136792 Sep 18 00:58:26.633185 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 169/323] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:26 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:26.870675 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-dfe98f9a-5725-4f51-a0a9-fe409f1ed818 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:26.871634 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-dfe98f9a-5725-4f51-a0a9-fe409f1ed818 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:26.880680 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfe98f9a-5725-4f51-a0a9-fe409f1ed818 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:26.881418 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfe98f9a-5725-4f51-a0a9-fe409f1ed818 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:26.882217 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfe98f9a-5725-4f51-a0a9-fe409f1ed818 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:26.883128 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfe98f9a-5725-4f51-a0a9-fe409f1ed818 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:26.883829 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfe98f9a-5725-4f51-a0a9-fe409f1ed818 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:26.884413 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dfe98f9a-5725-4f51-a0a9-fe409f1ed818 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:26.971186 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d05560e0-3459-4bd1-8077-1f40fbbdd978 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:26.980966 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d05560e0-3459-4bd1-8077-1f40fbbdd978 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1318 microversion: 2.1 time: 0.464278 Sep 18 00:58:26.995162 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 155/324] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:26 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:27.202246 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-dfe98f9a-5725-4f51-a0a9-fe409f1ed818 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:27.219611 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-dfe98f9a-5725-4f51-a0a9-fe409f1ed818 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1367 microversion: 2.1 time: 0.356293 Sep 18 00:58:27.224964 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 170/325] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:26 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:27.371774 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:27.373103 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:27.401208 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:27.402600 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:27.406640 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:27.412991 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:27.414045 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:27.415081 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:27.640187 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0f7e3cda-5f86-422a-92c0-e5c98f31bd45 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:27.641527 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0f7e3cda-5f86-422a-92c0-e5c98f31bd45 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:27.644008 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:27.654514 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f7e3cda-5f86-422a-92c0-e5c98f31bd45 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:27.659546 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f7e3cda-5f86-422a-92c0-e5c98f31bd45 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:27.671635 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f7e3cda-5f86-422a-92c0-e5c98f31bd45 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:27.673158 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f7e3cda-5f86-422a-92c0-e5c98f31bd45 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:27.674172 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f7e3cda-5f86-422a-92c0-e5c98f31bd45 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:27.675109 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f7e3cda-5f86-422a-92c0-e5c98f31bd45 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:27.856731 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:27.884101 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:27.892702 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:27.893928 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-ffe1c939-ddf3-4daf-955d-a4f5d9861f77 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.526269 Sep 18 00:58:27.899821 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 156/326] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:27 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:27.916033 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-49a5c5f2-4fae-4a6f-8855-dfe6688a6170 req-c62fa493-8c88-4fa3-9c9b-45000291a344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b142dfeb-6de9-4d35-9b1e-b0545715235b", "name": "network-vif-plugged", "status": "completed", "tag": "52a424bc-9fbd-479c-b108-af4ee47377ab"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:27.931285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-49a5c5f2-4fae-4a6f-8855-dfe6688a6170 req-c62fa493-8c88-4fa3-9c9b-45000291a344 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:27.932151 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-49a5c5f2-4fae-4a6f-8855-dfe6688a6170 req-c62fa493-8c88-4fa3-9c9b-45000291a344 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:27.932827 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-49a5c5f2-4fae-4a6f-8855-dfe6688a6170 req-c62fa493-8c88-4fa3-9c9b-45000291a344 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:27.949574 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-49a5c5f2-4fae-4a6f-8855-dfe6688a6170 req-c62fa493-8c88-4fa3-9c9b-45000291a344 service nova] Creating event network-vif-plugged:52a424bc-9fbd-479c-b108-af4ee47377ab for instance b142dfeb-6de9-4d35-9b1e-b0545715235b on hv-cinder-maste Sep 18 00:58:27.955886 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-49a5c5f2-4fae-4a6f-8855-dfe6688a6170 req-c62fa493-8c88-4fa3-9c9b-45000291a344 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055353 Sep 18 00:58:27.957237 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 157/327] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:28.010739 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-960eb308-af59-41e7-b03d-05fd33042a7d tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:28.011699 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-960eb308-af59-41e7-b03d-05fd33042a7d tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:28.022806 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960eb308-af59-41e7-b03d-05fd33042a7d tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:28.027693 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960eb308-af59-41e7-b03d-05fd33042a7d tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:28.028305 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960eb308-af59-41e7-b03d-05fd33042a7d tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:28.029708 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960eb308-af59-41e7-b03d-05fd33042a7d tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:28.030295 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960eb308-af59-41e7-b03d-05fd33042a7d tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:28.031550 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960eb308-af59-41e7-b03d-05fd33042a7d tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:28.305567 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:28.327096 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=12 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:28.409291 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-0f7e3cda-5f86-422a-92c0-e5c98f31bd45 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:28.419421 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0f7e3cda-5f86-422a-92c0-e5c98f31bd45 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1372 microversion: 2.1 time: 0.783669 Sep 18 00:58:28.426783 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 171/328] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:27 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1372 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:28.440116 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-390014fa-4d91-4a6b-b8fe-9b1d109090d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:28.441806 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-390014fa-4d91-4a6b-b8fe-9b1d109090d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:28.468354 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-390014fa-4d91-4a6b-b8fe-9b1d109090d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:28.468903 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-390014fa-4d91-4a6b-b8fe-9b1d109090d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:28.469342 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-390014fa-4d91-4a6b-b8fe-9b1d109090d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:28.470064 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-390014fa-4d91-4a6b-b8fe-9b1d109090d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:28.470519 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-390014fa-4d91-4a6b-b8fe-9b1d109090d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:28.471107 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-390014fa-4d91-4a6b-b8fe-9b1d109090d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:28.473843 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-960eb308-af59-41e7-b03d-05fd33042a7d tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:28.483469 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-960eb308-af59-41e7-b03d-05fd33042a7d tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1318 microversion: 2.1 time: 0.477115 Sep 18 00:58:28.508173 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 158/329] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:28 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:28.923042 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:28.931794 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:28.939822 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-390014fa-4d91-4a6b-b8fe-9b1d109090d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:28.948139 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:28.948640 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:28.949081 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:28.961135 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:28.961627 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:28.962285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:28.985893 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-390014fa-4d91-4a6b-b8fe-9b1d109090d6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1367 microversion: 2.1 time: 0.556690 Sep 18 00:58:28.987352 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 172/330] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:28 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1367 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:29.442129 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b966ef73-ccda-46a6-9afd-6469532c3a9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:29.444266 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b966ef73-ccda-46a6-9afd-6469532c3a9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:29.455855 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b966ef73-ccda-46a6-9afd-6469532c3a9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:29.456696 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b966ef73-ccda-46a6-9afd-6469532c3a9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:29.457340 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b966ef73-ccda-46a6-9afd-6469532c3a9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:29.459138 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b966ef73-ccda-46a6-9afd-6469532c3a9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:29.459790 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b966ef73-ccda-46a6-9afd-6469532c3a9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:29.461382 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b966ef73-ccda-46a6-9afd-6469532c3a9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:29.717801 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:29.735415 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:29.740470 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:29.744107 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0eacb8d4-033d-4143-9658-933d5ace7476 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.828160 Sep 18 00:58:29.746320 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 159/331] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:28 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:58:29.751341 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-b966ef73-ccda-46a6-9afd-6469532c3a9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:29.754269 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0b7b6f95-2f57-455e-823a-d9e81fd1d7c9 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:29.755488 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0b7b6f95-2f57-455e-823a-d9e81fd1d7c9 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:29.759381 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b966ef73-ccda-46a6-9afd-6469532c3a9b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1372 microversion: 2.1 time: 0.321192 Sep 18 00:58:29.764319 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0b7b6f95-2f57-455e-823a-d9e81fd1d7c9 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:29.765719 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0b7b6f95-2f57-455e-823a-d9e81fd1d7c9 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:29.799762 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0b7b6f95-2f57-455e-823a-d9e81fd1d7c9 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:29.800057 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 173/332] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:29 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:29.801377 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0b7b6f95-2f57-455e-823a-d9e81fd1d7c9 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:29.802068 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0b7b6f95-2f57-455e-823a-d9e81fd1d7c9 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:29.802718 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0b7b6f95-2f57-455e-823a-d9e81fd1d7c9 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:30.018461 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ca4f3a60-1a00-41b1-b46b-23bc4bad2c30 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:30.020135 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ca4f3a60-1a00-41b1-b46b-23bc4bad2c30 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:30.037027 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4f3a60-1a00-41b1-b46b-23bc4bad2c30 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:30.037542 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4f3a60-1a00-41b1-b46b-23bc4bad2c30 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:30.038146 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4f3a60-1a00-41b1-b46b-23bc4bad2c30 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:30.039011 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4f3a60-1a00-41b1-b46b-23bc4bad2c30 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:30.039483 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4f3a60-1a00-41b1-b46b-23bc4bad2c30 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:30.040027 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca4f3a60-1a00-41b1-b46b-23bc4bad2c30 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:30.106069 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0b7b6f95-2f57-455e-823a-d9e81fd1d7c9 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:30.123834 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0b7b6f95-2f57-455e-823a-d9e81fd1d7c9 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1318 microversion: 2.1 time: 0.375301 Sep 18 00:58:30.124927 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 160/333] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:29 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:30.153158 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-507e0567-b0d6-4b00-9c6c-1fb3e12fe1b3 req-8f5e5f30-4787-467f-bab7-0e5844db5e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc591cc-e74d-48ea-85e8-945b2995d123", "tag": "9608eb83-8531-414f-a482-f625b3b31cb2"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:30.163606 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-507e0567-b0d6-4b00-9c6c-1fb3e12fe1b3 req-8f5e5f30-4787-467f-bab7-0e5844db5e02 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:30.164664 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-507e0567-b0d6-4b00-9c6c-1fb3e12fe1b3 req-8f5e5f30-4787-467f-bab7-0e5844db5e02 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:30.164664 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-507e0567-b0d6-4b00-9c6c-1fb3e12fe1b3 req-8f5e5f30-4787-467f-bab7-0e5844db5e02 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:30.177754 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-507e0567-b0d6-4b00-9c6c-1fb3e12fe1b3 req-8f5e5f30-4787-467f-bab7-0e5844db5e02 service nova] Creating event network-changed:9608eb83-8531-414f-a482-f625b3b31cb2 for instance ecc591cc-e74d-48ea-85e8-945b2995d123 on hv-cinder-maste Sep 18 00:58:30.182655 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-507e0567-b0d6-4b00-9c6c-1fb3e12fe1b3 req-8f5e5f30-4787-467f-bab7-0e5844db5e02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036170 Sep 18 00:58:30.183763 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 161/334] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:58:30.476146 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ca4f3a60-1a00-41b1-b46b-23bc4bad2c30 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:30.485956 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ca4f3a60-1a00-41b1-b46b-23bc4bad2c30 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1367 microversion: 2.1 time: 0.475722 Sep 18 00:58:30.488612 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 174/335] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:30 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:30.771734 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:30.772603 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:30.790125 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:30.790533 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:30.791009 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:30.791812 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:30.792169 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:30.792599 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:30.803809 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a111eed3-f47c-4c96-ab69-dd38d1aab5bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:30.804437 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-a111eed3-f47c-4c96-ab69-dd38d1aab5bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:30.818270 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a111eed3-f47c-4c96-ab69-dd38d1aab5bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:30.833167 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a111eed3-f47c-4c96-ab69-dd38d1aab5bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:30.833723 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a111eed3-f47c-4c96-ab69-dd38d1aab5bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:30.834495 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a111eed3-f47c-4c96-ab69-dd38d1aab5bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:30.835008 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a111eed3-f47c-4c96-ab69-dd38d1aab5bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:30.842501 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a111eed3-f47c-4c96-ab69-dd38d1aab5bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:31.367185 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:31.382754 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:31.385224 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:31.386621 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c931d000-d88d-4c6f-a1d2-b97f4029a806 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.619308 Sep 18 00:58:31.392314 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 162/336] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:30 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:31.424854 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-57095a88-1bc0-4cc2-a29b-b776cdcb9e43 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:31.426738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-57095a88-1bc0-4cc2-a29b-b776cdcb9e43 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:31.447070 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57095a88-1bc0-4cc2-a29b-b776cdcb9e43 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:31.447848 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57095a88-1bc0-4cc2-a29b-b776cdcb9e43 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:31.448465 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57095a88-1bc0-4cc2-a29b-b776cdcb9e43 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:31.449344 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57095a88-1bc0-4cc2-a29b-b776cdcb9e43 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:31.449988 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57095a88-1bc0-4cc2-a29b-b776cdcb9e43 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:31.451660 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-57095a88-1bc0-4cc2-a29b-b776cdcb9e43 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:31.535077 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a111eed3-f47c-4c96-ab69-dd38d1aab5bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:31.546776 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a111eed3-f47c-4c96-ab69-dd38d1aab5bf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1372 microversion: 2.1 time: 0.746046 Sep 18 00:58:31.548353 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 175/337] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:30 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1372 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:31.554448 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-e97d6087-224d-4fb5-a066-868c79837569 req-7a020693-2e98-4196-b05c-701be3d90579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "234a399b-97be-4b3b-8bdb-75278ffdc4e0", "name": "network-vif-plugged", "status": "completed", "tag": "41adca23-a8d9-445c-9eaa-f1623bb2425c"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:31.567596 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-e97d6087-224d-4fb5-a066-868c79837569 req-7a020693-2e98-4196-b05c-701be3d90579 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:31.568523 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-e97d6087-224d-4fb5-a066-868c79837569 req-7a020693-2e98-4196-b05c-701be3d90579 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:31.569199 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-e97d6087-224d-4fb5-a066-868c79837569 req-7a020693-2e98-4196-b05c-701be3d90579 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:31.584507 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-e97d6087-224d-4fb5-a066-868c79837569 req-7a020693-2e98-4196-b05c-701be3d90579 service nova] Creating event network-vif-plugged:41adca23-a8d9-445c-9eaa-f1623bb2425c for instance 234a399b-97be-4b3b-8bdb-75278ffdc4e0 on hv-cinder-maste Sep 18 00:58:31.594820 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-e97d6087-224d-4fb5-a066-868c79837569 req-7a020693-2e98-4196-b05c-701be3d90579 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044621 Sep 18 00:58:31.595969 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 176/338] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:31.601636 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f6885b88-44b8-4f2b-96d3-3f583beb6771 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:31.602408 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f6885b88-44b8-4f2b-96d3-3f583beb6771 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:31.609584 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f6885b88-44b8-4f2b-96d3-3f583beb6771 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:31.610311 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f6885b88-44b8-4f2b-96d3-3f583beb6771 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:31.611162 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f6885b88-44b8-4f2b-96d3-3f583beb6771 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:31.611944 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f6885b88-44b8-4f2b-96d3-3f583beb6771 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:31.612556 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f6885b88-44b8-4f2b-96d3-3f583beb6771 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:31.613052 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f6885b88-44b8-4f2b-96d3-3f583beb6771 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:32.009033 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f6885b88-44b8-4f2b-96d3-3f583beb6771 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:32.018102 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-57095a88-1bc0-4cc2-a29b-b776cdcb9e43 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:32.021294 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f6885b88-44b8-4f2b-96d3-3f583beb6771 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1556 microversion: 2.1 time: 0.424012 Sep 18 00:58:32.021885 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 177/339] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:31 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1556 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:32.043782 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-57095a88-1bc0-4cc2-a29b-b776cdcb9e43 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1318 microversion: 2.1 time: 0.649831 Sep 18 00:58:32.044983 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 163/340] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:31 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1318 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:32.049168 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-83830dcf-78a5-449f-886f-dde36340c754 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:32.049674 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-83830dcf-78a5-449f-886f-dde36340c754 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:32.066628 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-83830dcf-78a5-449f-886f-dde36340c754 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:32.067853 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-83830dcf-78a5-449f-886f-dde36340c754 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:32.068464 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-83830dcf-78a5-449f-886f-dde36340c754 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:32.070606 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-83830dcf-78a5-449f-886f-dde36340c754 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:32.071102 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-83830dcf-78a5-449f-886f-dde36340c754 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:32.072500 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-83830dcf-78a5-449f-886f-dde36340c754 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:32.226363 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-83830dcf-78a5-449f-886f-dde36340c754 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183663 Sep 18 00:58:32.227860 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 178/341] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 18 00:58:32 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:32.423278 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:32.424199 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:32.430523 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:32.431271 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:32.432125 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:32.433235 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:32.433863 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:32.434570 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:32.582707 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e5f4b6a2-4aae-4ad0-8104-509f07e4a3b6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:32.583959 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e5f4b6a2-4aae-4ad0-8104-509f07e4a3b6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:32.591659 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5f4b6a2-4aae-4ad0-8104-509f07e4a3b6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:32.592317 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5f4b6a2-4aae-4ad0-8104-509f07e4a3b6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:32.592944 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5f4b6a2-4aae-4ad0-8104-509f07e4a3b6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:32.593852 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5f4b6a2-4aae-4ad0-8104-509f07e4a3b6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:32.594479 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5f4b6a2-4aae-4ad0-8104-509f07e4a3b6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:32.595097 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5f4b6a2-4aae-4ad0-8104-509f07e4a3b6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:32.682229 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:32.927211 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=20 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:33.297516 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:33.313999 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:33.316464 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:33.318092 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-549c4ce0-6168-419b-8405-b2129afb3472 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.899995 Sep 18 00:58:33.318666 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 164/342] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:32 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:33.328393 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-cd71431e-4a00-41cd-81da-a31833534513 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:33.333348 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-cd71431e-4a00-41cd-81da-a31833534513 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:33.349365 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd71431e-4a00-41cd-81da-a31833534513 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:33.350191 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd71431e-4a00-41cd-81da-a31833534513 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:33.352257 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd71431e-4a00-41cd-81da-a31833534513 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:33.355695 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd71431e-4a00-41cd-81da-a31833534513 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:33.356866 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd71431e-4a00-41cd-81da-a31833534513 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:33.358724 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd71431e-4a00-41cd-81da-a31833534513 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:33.527582 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e5f4b6a2-4aae-4ad0-8104-509f07e4a3b6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:33.547273 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e5f4b6a2-4aae-4ad0-8104-509f07e4a3b6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1372 microversion: 2.1 time: 0.960056 Sep 18 00:58:33.570878 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 179/343] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:32 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1372 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:33.700339 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-cd71431e-4a00-41cd-81da-a31833534513 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:33.720322 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-cd71431e-4a00-41cd-81da-a31833534513 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1318 microversion: 2.1 time: 0.395244 Sep 18 00:58:33.725925 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 165/344] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:33 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:34.351841 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:34.352722 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:34.364416 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:34.364905 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:34.365341 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:34.366053 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:34.369007 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:34.369672 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:34.586074 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9d1f977f-c705-49dc-8a9a-fbee182b34dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:34.586616 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9d1f977f-c705-49dc-8a9a-fbee182b34dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:34.598164 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9d1f977f-c705-49dc-8a9a-fbee182b34dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:34.598903 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9d1f977f-c705-49dc-8a9a-fbee182b34dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:34.601388 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9d1f977f-c705-49dc-8a9a-fbee182b34dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:34.602312 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9d1f977f-c705-49dc-8a9a-fbee182b34dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:34.605461 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9d1f977f-c705-49dc-8a9a-fbee182b34dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:34.606867 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9d1f977f-c705-49dc-8a9a-fbee182b34dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:35.147408 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:35.163665 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:35.168704 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:35.185772 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d71094d3-2fbd-4948-8882-ec6cc26490a8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.837965 Sep 18 00:58:35.191448 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 180/345] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:34 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:35.204632 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8979c4b3-2342-4daf-9179-829a4c86499a tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:35.206053 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8979c4b3-2342-4daf-9179-829a4c86499a tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:35.224270 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8979c4b3-2342-4daf-9179-829a4c86499a tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:35.228850 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8979c4b3-2342-4daf-9179-829a4c86499a tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:35.229024 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9d1f977f-c705-49dc-8a9a-fbee182b34dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:35.229770 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8979c4b3-2342-4daf-9179-829a4c86499a tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:35.232508 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8979c4b3-2342-4daf-9179-829a4c86499a tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:35.233257 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8979c4b3-2342-4daf-9179-829a4c86499a tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:35.236651 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8979c4b3-2342-4daf-9179-829a4c86499a tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:35.245926 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9d1f977f-c705-49dc-8a9a-fbee182b34dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1372 microversion: 2.1 time: 0.657262 Sep 18 00:58:35.250454 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 166/346] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:34 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1372 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:35.270751 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-0a1d7fd5-8aa7-49f2-8136-ffbc1152771f req-b8f45a59-7fcd-4ba8-a6d5-7c06e4544026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b142dfeb-6de9-4d35-9b1e-b0545715235b", "tag": "52a424bc-9fbd-479c-b108-af4ee47377ab"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:35.307675 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-0a1d7fd5-8aa7-49f2-8136-ffbc1152771f req-b8f45a59-7fcd-4ba8-a6d5-7c06e4544026 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:35.329301 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-0a1d7fd5-8aa7-49f2-8136-ffbc1152771f req-b8f45a59-7fcd-4ba8-a6d5-7c06e4544026 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:35.329948 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-0a1d7fd5-8aa7-49f2-8136-ffbc1152771f req-b8f45a59-7fcd-4ba8-a6d5-7c06e4544026 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:35.394145 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-0a1d7fd5-8aa7-49f2-8136-ffbc1152771f req-b8f45a59-7fcd-4ba8-a6d5-7c06e4544026 service nova] Creating event network-changed:52a424bc-9fbd-479c-b108-af4ee47377ab for instance b142dfeb-6de9-4d35-9b1e-b0545715235b on hv-cinder-maste Sep 18 00:58:35.421529 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-0a1d7fd5-8aa7-49f2-8136-ffbc1152771f req-b8f45a59-7fcd-4ba8-a6d5-7c06e4544026 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168822 Sep 18 00:58:35.423747 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 167/347] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:35.809781 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-8979c4b3-2342-4daf-9179-829a4c86499a tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:35.840853 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8979c4b3-2342-4daf-9179-829a4c86499a tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1507 microversion: 2.1 time: 0.647658 Sep 18 00:58:35.851991 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 181/348] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:35 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:36.220316 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:36.221716 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:36.232878 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:36.235786 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:36.236242 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:36.239219 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:36.239702 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:36.240141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:36.288396 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-29b07c3a-b264-4040-b625-316e57472457 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:36.292737 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-29b07c3a-b264-4040-b625-316e57472457 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:36.320955 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29b07c3a-b264-4040-b625-316e57472457 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:36.321718 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29b07c3a-b264-4040-b625-316e57472457 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:36.322338 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29b07c3a-b264-4040-b625-316e57472457 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:36.323266 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29b07c3a-b264-4040-b625-316e57472457 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:36.323729 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29b07c3a-b264-4040-b625-316e57472457 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:36.324158 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29b07c3a-b264-4040-b625-316e57472457 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:36.828340 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:36.847367 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:36.856874 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:36.859961 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4028d9ef-af30-405e-97a5-a9bec7918b10 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.645879 Sep 18 00:58:36.864958 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 168/349] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:36 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:36.906504 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-29b07c3a-b264-4040-b625-316e57472457 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:36.926149 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-29b07c3a-b264-4040-b625-316e57472457 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1372 microversion: 2.1 time: 0.646096 Sep 18 00:58:36.945016 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 182/350] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:36 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1372 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:37.892229 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:37.893535 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:37.909043 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:37.910587 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:37.911355 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:37.913681 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:37.914363 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:37.914994 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:37.963565 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d1d149c7-85ae-4b6c-992b-b8044cd73db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:37.965443 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d1d149c7-85ae-4b6c-992b-b8044cd73db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:37.977754 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1d149c7-85ae-4b6c-992b-b8044cd73db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:37.978475 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1d149c7-85ae-4b6c-992b-b8044cd73db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:37.979134 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1d149c7-85ae-4b6c-992b-b8044cd73db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:37.985158 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1d149c7-85ae-4b6c-992b-b8044cd73db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:37.985937 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1d149c7-85ae-4b6c-992b-b8044cd73db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:37.986965 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1d149c7-85ae-4b6c-992b-b8044cd73db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:38.369047 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:38.389917 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:38.396372 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d1d149c7-85ae-4b6c-992b-b8044cd73db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:38.411598 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:38.415040 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d1d149c7-85ae-4b6c-992b-b8044cd73db3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1372 microversion: 2.1 time: 0.458778 Sep 18 00:58:38.416133 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0319c0c9-9b16-426f-b9b2-ed6d09f5377c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.527971 Sep 18 00:58:38.416941 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 183/351] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:37 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1372 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:58:38.418877 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 169/352] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:37 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:39.451002 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:39.452692 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:39.455633 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-387679fe-d4fe-414e-a272-d69df9c3878e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:39.457498 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-387679fe-d4fe-414e-a272-d69df9c3878e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:39.477348 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:39.477868 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:39.480329 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-387679fe-d4fe-414e-a272-d69df9c3878e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:39.481919 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:39.482719 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:39.483178 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-387679fe-d4fe-414e-a272-d69df9c3878e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:39.483640 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-387679fe-d4fe-414e-a272-d69df9c3878e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:39.484362 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-387679fe-d4fe-414e-a272-d69df9c3878e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:39.485803 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:39.486301 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:39.487803 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-387679fe-d4fe-414e-a272-d69df9c3878e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:39.491842 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-387679fe-d4fe-414e-a272-d69df9c3878e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:40.197784 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-387679fe-d4fe-414e-a272-d69df9c3878e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:40.220207 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-387679fe-d4fe-414e-a272-d69df9c3878e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1372 microversion: 2.1 time: 0.773674 Sep 18 00:58:40.220981 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 184/353] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:39 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1372 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:40.282931 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:40.296274 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:40.297872 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:40.305606 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f49182cf-7839-4cf1-91e2-ab57da2b27df tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.862285 Sep 18 00:58:40.306506 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 170/354] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:39 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:58:41.248598 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2a67c736-b041-4643-9b7f-186948b6d922 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:41.251235 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-2a67c736-b041-4643-9b7f-186948b6d922 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:41.264445 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2a67c736-b041-4643-9b7f-186948b6d922 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:41.267690 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2a67c736-b041-4643-9b7f-186948b6d922 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:41.269124 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2a67c736-b041-4643-9b7f-186948b6d922 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:41.278459 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2a67c736-b041-4643-9b7f-186948b6d922 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:41.292250 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2a67c736-b041-4643-9b7f-186948b6d922 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:41.293945 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2a67c736-b041-4643-9b7f-186948b6d922 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:41.341177 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:41.341812 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:41.364471 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:41.365619 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:41.366268 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:41.367023 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:41.369593 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=100 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:41.370005 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:41.371812 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:41.935984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2a67c736-b041-4643-9b7f-186948b6d922 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:41.955332 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2a67c736-b041-4643-9b7f-186948b6d922 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1372 microversion: 2.1 time: 0.712868 Sep 18 00:58:41.957506 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 185/355] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:41 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1372 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:41.974990 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-b79296b4-b190-4bd6-967c-65f4ceba735a req-3b4bc13f-829b-4210-9a1e-3ff7b4f83d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc591cc-e74d-48ea-85e8-945b2995d123", "name": "network-vif-plugged", "status": "completed", "tag": "9608eb83-8531-414f-a482-f625b3b31cb2"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:41.991357 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-b79296b4-b190-4bd6-967c-65f4ceba735a req-3b4bc13f-829b-4210-9a1e-3ff7b4f83d24 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:41.992119 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-b79296b4-b190-4bd6-967c-65f4ceba735a req-3b4bc13f-829b-4210-9a1e-3ff7b4f83d24 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:41.992958 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-b79296b4-b190-4bd6-967c-65f4ceba735a req-3b4bc13f-829b-4210-9a1e-3ff7b4f83d24 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:42.014644 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-b79296b4-b190-4bd6-967c-65f4ceba735a req-3b4bc13f-829b-4210-9a1e-3ff7b4f83d24 service nova] Creating event network-vif-plugged:9608eb83-8531-414f-a482-f625b3b31cb2 for instance ecc591cc-e74d-48ea-85e8-945b2995d123 on hv-cinder-maste Sep 18 00:58:42.021091 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-b79296b4-b190-4bd6-967c-65f4ceba735a req-3b4bc13f-829b-4210-9a1e-3ff7b4f83d24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053252 Sep 18 00:58:42.021974 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 186/356] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:42.053526 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:42.070042 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:42.074664 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:42.076491 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4326ea10-243e-4d81-9c18-fb76a519e0b7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.741466 Sep 18 00:58:42.083911 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 171/357] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:41 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:42.990110 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-64a58f7d-d848-452e-9cf7-dc7e9dad9c56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:42.990858 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-64a58f7d-d848-452e-9cf7-dc7e9dad9c56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:43.001144 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64a58f7d-d848-452e-9cf7-dc7e9dad9c56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:43.002178 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64a58f7d-d848-452e-9cf7-dc7e9dad9c56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:43.002805 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64a58f7d-d848-452e-9cf7-dc7e9dad9c56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:43.003716 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64a58f7d-d848-452e-9cf7-dc7e9dad9c56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:43.004466 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64a58f7d-d848-452e-9cf7-dc7e9dad9c56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:43.005157 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64a58f7d-d848-452e-9cf7-dc7e9dad9c56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:43.118948 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:43.121324 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:43.132773 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:43.136368 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:43.137219 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:43.138174 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:43.138821 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:43.139399 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:43.213663 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=100 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:43.365786 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-64a58f7d-d848-452e-9cf7-dc7e9dad9c56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:43.377447 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-64a58f7d-d848-452e-9cf7-dc7e9dad9c56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1372 microversion: 2.1 time: 0.392181 Sep 18 00:58:43.382025 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 187/358] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:42 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1372 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:43.452678 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:43.470447 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:43.471957 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:43.476408 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-421275b7-c41c-4ae3-9a4e-d4e518229c45 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.359504 Sep 18 00:58:43.477360 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 172/359] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:43 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:58:43.809598 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-24a6f491-0bdc-4eb0-9fa7-c39845711da6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Action: 'create', calling method: .version_select at 0x7f5672b90b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-560900150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTi5MlZdBJ8NBycbsAHnBxLfC2UJBxXwCYXTrlq3m0wSmVNhVebtuAZv5BFvz+9vMnXZz8Re2JCHB0lscJ5hgZ4n+5sYJecPQFREdOjotzc6A8IuBqFRLOFmzfElgQkqw=="}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:43.850379 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-24a6f491-0bdc-4eb0-9fa7-c39845711da6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Getting quotas for project c37316ddc7de431294eda723f5ef3f60. Resources: {'key_pairs'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:58:43.856802 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-24a6f491-0bdc-4eb0-9fa7-c39845711da6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Getting quotas for user a1b91804a3e840858e0dc695e8f1d89f and project c37316ddc7de431294eda723f5ef3f60. Resources: {'key_pairs'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:58:43.896879 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-24a6f491-0bdc-4eb0-9fa7-c39845711da6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.351015 Sep 18 00:58:43.897640 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 188/360] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 18 00:58:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:44.411544 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f61693bc-c588-4dce-9afa-f60f038a0075 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:44.412304 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f61693bc-c588-4dce-9afa-f60f038a0075 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:44.419795 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f61693bc-c588-4dce-9afa-f60f038a0075 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:44.420284 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f61693bc-c588-4dce-9afa-f60f038a0075 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:44.420716 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f61693bc-c588-4dce-9afa-f60f038a0075 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:44.421410 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f61693bc-c588-4dce-9afa-f60f038a0075 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:44.421971 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f61693bc-c588-4dce-9afa-f60f038a0075 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:44.422276 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f61693bc-c588-4dce-9afa-f60f038a0075 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:44.507645 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:44.508349 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:44.519653 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:44.525086 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:44.525636 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:44.526474 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:44.527604 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:44.528107 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:44.613072 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f61693bc-c588-4dce-9afa-f60f038a0075 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:44.625020 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f61693bc-c588-4dce-9afa-f60f038a0075 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1566 microversion: 2.1 time: 0.218565 Sep 18 00:58:44.626951 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 173/361] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:58:44 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:58:44.650822 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7788fb9f-d59e-4bbb-9959-cf1680957b07 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:44.651341 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7788fb9f-d59e-4bbb-9959-cf1680957b07 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:44.659778 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7788fb9f-d59e-4bbb-9959-cf1680957b07 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:44.660528 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7788fb9f-d59e-4bbb-9959-cf1680957b07 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:44.661040 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7788fb9f-d59e-4bbb-9959-cf1680957b07 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:44.662495 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7788fb9f-d59e-4bbb-9959-cf1680957b07 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:44.663295 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7788fb9f-d59e-4bbb-9959-cf1680957b07 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:44.664391 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7788fb9f-d59e-4bbb-9959-cf1680957b07 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:44.697270 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:44.711019 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:44.712578 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:44.713780 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-fd1acf4f-e35a-44d9-b3d2-a3623e85b43a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1740 microversion: 2.20 time: 0.210778 Sep 18 00:58:44.714859 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 189/362] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:44 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:44.791020 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7788fb9f-d59e-4bbb-9959-cf1680957b07 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144447 Sep 18 00:58:44.791729 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 174/363] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 18 00:58:44 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:45.741772 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:45.742374 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:45.754345 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:45.757082 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:45.757565 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:45.758401 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:45.759018 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:45.759351 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:46.228468 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:46.237400 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:46.239147 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:46.240323 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-16534ad6-0f2f-42d8-aa21-815d821863d6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1722 microversion: 2.20 time: 0.503819 Sep 18 00:58:46.240927 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 190/364] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:45 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1722 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:46.865375 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-70c8b9e0-138e-400d-a9fa-c65cd1d47e97 req-71696290-2e2b-4cb5-8fa0-66caa31abbec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc591cc-e74d-48ea-85e8-945b2995d123", "tag": "9608eb83-8531-414f-a482-f625b3b31cb2"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:46.877966 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-70c8b9e0-138e-400d-a9fa-c65cd1d47e97 req-71696290-2e2b-4cb5-8fa0-66caa31abbec service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:46.879327 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-70c8b9e0-138e-400d-a9fa-c65cd1d47e97 req-71696290-2e2b-4cb5-8fa0-66caa31abbec service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:46.879866 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-70c8b9e0-138e-400d-a9fa-c65cd1d47e97 req-71696290-2e2b-4cb5-8fa0-66caa31abbec service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:46.901510 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-70c8b9e0-138e-400d-a9fa-c65cd1d47e97 req-71696290-2e2b-4cb5-8fa0-66caa31abbec service nova] Creating event network-changed:9608eb83-8531-414f-a482-f625b3b31cb2 for instance ecc591cc-e74d-48ea-85e8-945b2995d123 on hv-cinder-maste Sep 18 00:58:46.909114 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-70c8b9e0-138e-400d-a9fa-c65cd1d47e97 req-71696290-2e2b-4cb5-8fa0-66caa31abbec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051043 Sep 18 00:58:46.909716 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 175/365] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:47.271068 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:47.271681 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:47.279538 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:47.280040 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:47.280918 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:47.281652 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:47.282113 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:47.282541 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:47.425412 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:47.433770 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:47.435354 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:47.436621 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a8986e46-7440-4be5-abc6-127aa1f22b3f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1722 microversion: 2.20 time: 0.169470 Sep 18 00:58:47.437195 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 191/366] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:47 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:48.462694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:48.463513 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:48.470423 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:48.471049 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:48.471492 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:48.472323 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:48.472825 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:48.473249 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:48.618929 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:48.627492 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:48.628935 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:48.630089 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-45fe3f2d-27b8-4bbf-a70b-340d0bb28125 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1722 microversion: 2.20 time: 0.172342 Sep 18 00:58:48.630652 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 176/367] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:48 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:49.237155 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-4fce17ce-6c8b-420e-a3ac-d52cd4eb7a3b req-a132b913-fc8d-4d54-b4b7-fd6b4e75275a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cf145a-d8d5-4a7e-937b-729bf79629fa", "name": "network-vif-unplugged", "status": "completed", "tag": "3b10ed6a-bc95-40e6-afaa-4936e44594eb"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:49.249032 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-4fce17ce-6c8b-420e-a3ac-d52cd4eb7a3b req-a132b913-fc8d-4d54-b4b7-fd6b4e75275a service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:49.250164 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-4fce17ce-6c8b-420e-a3ac-d52cd4eb7a3b req-a132b913-fc8d-4d54-b4b7-fd6b4e75275a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:49.250656 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-4fce17ce-6c8b-420e-a3ac-d52cd4eb7a3b req-a132b913-fc8d-4d54-b4b7-fd6b4e75275a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:49.265990 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-4fce17ce-6c8b-420e-a3ac-d52cd4eb7a3b req-a132b913-fc8d-4d54-b4b7-fd6b4e75275a service nova] Creating event network-vif-unplugged:3b10ed6a-bc95-40e6-afaa-4936e44594eb for instance c1cf145a-d8d5-4a7e-937b-729bf79629fa on hv-cinder-maste Sep 18 00:58:49.271008 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-4fce17ce-6c8b-420e-a3ac-d52cd4eb7a3b req-a132b913-fc8d-4d54-b4b7-fd6b4e75275a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037927 Sep 18 00:58:49.272164 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 192/368] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:58:49.656022 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:49.657412 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:49.665250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:49.665896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:49.666366 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:49.667809 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:49.668377 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:49.668804 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:49.893241 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:49.906451 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:49.909096 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:49.910521 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-dc1723a3-1095-4e99-a06f-4e53540bca4f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1725 microversion: 2.20 time: 0.259063 Sep 18 00:58:49.911166 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 177/369] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:49 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1725 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:49.936755 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3ad2c123-07cd-4f98-9220-48f53d041f0c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dafd249-c2c9-4efe-9730-abc1f73242ec"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:49.939404 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3ad2c123-07cd-4f98-9220-48f53d041f0c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:49.945633 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3ad2c123-07cd-4f98-9220-48f53d041f0c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:49.946186 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3ad2c123-07cd-4f98-9220-48f53d041f0c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:49.946688 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3ad2c123-07cd-4f98-9220-48f53d041f0c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:49.947502 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3ad2c123-07cd-4f98-9220-48f53d041f0c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:49.948041 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3ad2c123-07cd-4f98-9220-48f53d041f0c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:49.948830 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3ad2c123-07cd-4f98-9220-48f53d041f0c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:50.257075 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3ad2c123-07cd-4f98-9220-48f53d041f0c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "POST /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325139 Sep 18 00:58:50.257707 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 193/370] 10.222.0.33 () {62 vars in 1364 bytes} [Sun Sep 18 00:58:49 2022] POST /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments => generated 188 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 00:58:50.390126 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4023448b-88cd-49be-848e-120bb88f713c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:50.390833 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4023448b-88cd-49be-848e-120bb88f713c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:50.396983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4023448b-88cd-49be-848e-120bb88f713c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:50.397649 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4023448b-88cd-49be-848e-120bb88f713c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:50.398113 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4023448b-88cd-49be-848e-120bb88f713c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:50.398836 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4023448b-88cd-49be-848e-120bb88f713c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:50.399354 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4023448b-88cd-49be-848e-120bb88f713c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:50.399751 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4023448b-88cd-49be-848e-120bb88f713c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:50.445438 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4023448b-88cd-49be-848e-120bb88f713c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120687) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 18 00:58:50.513663 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4023448b-88cd-49be-848e-120bb88f713c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "POST /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/action" status: 202 len: 0 microversion: 2.20 time: 0.127878 Sep 18 00:58:50.514266 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 178/371] 10.222.0.33 () {62 vars in 1319 bytes} [Sun Sep 18 00:58:50 2022] POST /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 00:58:50.522346 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:50.522992 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:50.529819 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:50.530310 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:50.530747 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:50.531475 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:50.531932 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:50.532356 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:50.675677 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:50.686043 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:50.687885 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:50.689209 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-39a0bad3-2217-40bb-ae33-85767d09613a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1751 microversion: 2.20 time: 0.170735 Sep 18 00:58:50.689874 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 194/372] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:50 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:58:51.719833 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:51.720506 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:51.726905 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:51.727861 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:51.728431 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:51.729127 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:51.729940 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:51.730546 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:51.875165 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:51.886133 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:51.888129 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:51.889286 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-188a82ef-0e5e-4c06-a7db-ed5f02b649d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1753 microversion: 2.20 time: 0.178412 Sep 18 00:58:51.889863 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 179/373] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:51 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:52.915255 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:52.915861 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:52.923073 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:52.923553 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:52.924021 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:52.924709 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:52.925164 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:52.925585 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:53.056550 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:53.065357 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:53.066733 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:53.067930 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2ed67263-c9ef-476d-90c0-30f572dbd793 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.156630 Sep 18 00:58:53.068487 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 195/374] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:52 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:54.093620 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:54.094201 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:54.100634 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:54.105988 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:54.106515 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:54.106987 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:54.107705 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:54.108178 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:54.108619 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:54.246445 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:54.256005 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:54.257660 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:54.258906 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-05ab5b87-3c92-49e5-b399-2df25592dcf8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.169217 Sep 18 00:58:54.259493 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 180/375] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:54 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:54.961117 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-892009ba-ad96-47d5-bc7a-e5b6b501e117 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9550c04-883f-401e-8fa4-f8dc0dfc74f9", "device": "/dev/sdb"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:58:54.969723 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-892009ba-ad96-47d5-bc7a-e5b6b501e117 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:54.977312 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=4 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:54.979378 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-892009ba-ad96-47d5-bc7a-e5b6b501e117 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:54.980218 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-892009ba-ad96-47d5-bc7a-e5b6b501e117 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:54.980668 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-892009ba-ad96-47d5-bc7a-e5b6b501e117 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:54.981439 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-892009ba-ad96-47d5-bc7a-e5b6b501e117 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:54.981903 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-892009ba-ad96-47d5-bc7a-e5b6b501e117 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:54.982336 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-892009ba-ad96-47d5-bc7a-e5b6b501e117 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:55.284906 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:55.285503 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:55.294543 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:55.295403 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:55.296081 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:55.297022 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:55.297652 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:55.298167 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:55.449152 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:55.459981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:55.461369 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:55.462541 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7533775c-c50d-494c-85b8-c7c90276c455 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.181786 Sep 18 00:58:55.463130 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 181/376] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:55 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:58:56.494076 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:56.497102 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:56.504861 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:56.505437 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:56.505965 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:56.506740 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:56.507228 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:56.507646 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:56.664374 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:56.674187 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:56.675702 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:56.676814 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-536d5445-eaec-4c6b-b53f-eb743b7fd343 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.190610 Sep 18 00:58:56.681353 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 182/377] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:56 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:58:57.701598 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:57.702263 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:57.708786 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:57.709275 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:57.709746 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:57.710530 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:57.711026 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:57.711569 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:57.866636 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:57.876734 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:57.878179 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:57.879395 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c5f08848-3a0d-4c16-95e4-9e09cd145d21 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.181774 Sep 18 00:58:57.879953 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 183/378] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:57 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:58:58.906726 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:58:58.907499 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:58:58.914312 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:58.914908 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:58.915351 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:58.916063 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:58:58.916554 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:58:58.917124 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:58:59.064929 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:59.074820 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:59.076264 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:58:59.077424 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-682c9728-cf90-4b5a-9a4c-0294bb1b0b08 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.175654 Sep 18 00:58:59.077976 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 184/379] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:58:58 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:00.103255 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:00.103970 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:00.110904 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:00.111389 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:00.111819 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:00.112511 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:00.112958 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:00.113374 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:00.266213 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:00.275571 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:00.277430 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:00.278593 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8dab4aac-fae6-4996-8fb4-dbb53f7e2930 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.179401 Sep 18 00:59:00.279178 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 185/380] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:00 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:01.305376 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:01.305998 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:01.312797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:01.313292 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:01.313733 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:01.314426 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:01.314910 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:01.315345 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:01.457373 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:01.466940 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:01.468371 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:01.469538 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-67a88962-7690-42c6-9a5f-80d5036dda8b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.168007 Sep 18 00:59:01.470092 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 186/381] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:01 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:59:02.497432 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:02.498311 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:02.505501 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:02.505981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:02.506454 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:02.507212 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:02.507668 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:02.508105 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:02.671384 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:02.682649 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:02.684149 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:02.685348 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8bf74629-92fe-4a1b-b38b-186a16e677e8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.194066 Sep 18 00:59:02.685919 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 187/382] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:02 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:59:03.712451 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:03.713916 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:03.721262 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:03.721860 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:03.722416 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:03.723161 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:03.723654 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:03.724083 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:03.865603 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:03.867810 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:03.877240 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:03.878663 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:03.879835 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-cbd895c3-f22b-4a73-ba21-d0189d5fe795 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.172457 Sep 18 00:59:03.880426 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 188/383] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:03 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:59:04.906753 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:04.908407 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:04.917875 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:04.919080 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:04.919852 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:04.921048 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:04.921983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:04.922825 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:04.979645 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:05.064507 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:05.101126 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:05.112557 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:05.114275 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:05.115522 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7bbe1ea1-c2c7-40ce-856b-89091c31b252 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.214302 Sep 18 00:59:05.116115 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 189/384] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:04 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:05.121214 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-655268013", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-560900150", "security_groups": [{"name": "tempest-secgroup-smoke-2058738160"}], "networks": [{"uuid": "2fe627c1-4c69-4373-8338-7690c696f294"}], "block_device_mapping_v2": [{"uuid": "448ba280-3e0b-4f7a-97b4-f8600a74a6ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:05.245768 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] validate_networks() for [('2fe627c1-4c69-4373-8338-7690c696f294', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:59:05.640455 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:59:05.640877 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:59:05.641391 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:59:05.641804 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:59:05.642216 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:59:05.652245 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:05.653038 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:05.653492 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:05.654438 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:05.655023 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:05.655630 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:05.675795 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Getting quotas for project c37316ddc7de431294eda723f5ef3f60. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:59:05.681805 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Getting quotas for user a1b91804a3e840858e0dc695e8f1d89f and project c37316ddc7de431294eda723f5ef3f60. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:59:05.740888 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:59:05.743342 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='448ba280-3e0b-4f7a-97b4-f8600a74a6ac',volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:59:05.887720 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-586c0094-0b7f-426e-98c7-9b5e189c26cd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.770533 Sep 18 00:59:05.888471 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 190/385] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:59:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:59:05.899636 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f5f63364-5a96-4df6-9395-6cc1c4dbfbeb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:05.900285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f5f63364-5a96-4df6-9395-6cc1c4dbfbeb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:05.954862 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f5f63364-5a96-4df6-9395-6cc1c4dbfbeb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:05.963256 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f5f63364-5a96-4df6-9395-6cc1c4dbfbeb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1087 microversion: 2.1 time: 0.066960 Sep 18 00:59:05.964058 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 191/386] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:05 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:06.142225 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:06.142896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:06.149149 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:06.149635 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:06.150070 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:06.151489 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:06.151952 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:06.152373 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:06.294049 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:06.303364 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:06.304900 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:06.306081 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3d4917ba-b69a-4174-8e9e-2ea958bacc93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.167841 Sep 18 00:59:06.307268 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 192/387] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:06 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:59:06.988192 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b8e5becc-e0b4-4c0c-ac86-5f0b9d4f5c35 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:06.988942 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b8e5becc-e0b4-4c0c-ac86-5f0b9d4f5c35 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:06.996288 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8e5becc-e0b4-4c0c-ac86-5f0b9d4f5c35 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:06.996796 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8e5becc-e0b4-4c0c-ac86-5f0b9d4f5c35 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:06.997233 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8e5becc-e0b4-4c0c-ac86-5f0b9d4f5c35 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:06.997875 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8e5becc-e0b4-4c0c-ac86-5f0b9d4f5c35 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:06.998360 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8e5becc-e0b4-4c0c-ac86-5f0b9d4f5c35 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:06.998816 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b8e5becc-e0b4-4c0c-ac86-5f0b9d4f5c35 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:07.064527 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b8e5becc-e0b4-4c0c-ac86-5f0b9d4f5c35 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:07.072461 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b8e5becc-e0b4-4c0c-ac86-5f0b9d4f5c35 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1129 microversion: 2.1 time: 0.088339 Sep 18 00:59:07.073417 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 193/388] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:06 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1129 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:07.099754 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-892009ba-ad96-47d5-bc7a-e5b6b501e117 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "POST /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.143159 Sep 18 00:59:07.100372 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 196/389] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 00:58:54 2022] POST /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0/os-volume_attachments => generated 194 bytes in 12145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:07.332498 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:07.333136 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:07.342114 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:07.342655 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:07.343127 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:07.343833 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:07.344292 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:07.344716 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:07.474818 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:07.483659 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:07.485094 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:07.486247 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a8eff89a-dcb3-4990-bd4e-0c05b0207b9a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.157662 Sep 18 00:59:07.486816 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 194/390] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:07 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:08.020766 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-afbf67d7-1b15-4198-8e80-582ef3d9280e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:08.021373 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-afbf67d7-1b15-4198-8e80-582ef3d9280e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:08.027727 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-afbf67d7-1b15-4198-8e80-582ef3d9280e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:08.028210 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-afbf67d7-1b15-4198-8e80-582ef3d9280e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:08.028646 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-afbf67d7-1b15-4198-8e80-582ef3d9280e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:08.029338 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-afbf67d7-1b15-4198-8e80-582ef3d9280e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:08.029794 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-afbf67d7-1b15-4198-8e80-582ef3d9280e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:08.030219 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-afbf67d7-1b15-4198-8e80-582ef3d9280e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:08.095132 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1a37e447-5cd0-4b1e-953a-9e8baf5c5eb6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:08.095741 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1a37e447-5cd0-4b1e-953a-9e8baf5c5eb6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:08.102521 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a37e447-5cd0-4b1e-953a-9e8baf5c5eb6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:08.102705 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a37e447-5cd0-4b1e-953a-9e8baf5c5eb6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:08.103191 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a37e447-5cd0-4b1e-953a-9e8baf5c5eb6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:08.104379 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a37e447-5cd0-4b1e-953a-9e8baf5c5eb6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:08.105140 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a37e447-5cd0-4b1e-953a-9e8baf5c5eb6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:08.105754 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a37e447-5cd0-4b1e-953a-9e8baf5c5eb6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:08.157093 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-afbf67d7-1b15-4198-8e80-582ef3d9280e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lazy-loading 'services' on Instance uuid abf6631e-213a-40ea-8708-5dc51da0ee8c {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:59:08.170860 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1a37e447-5cd0-4b1e-953a-9e8baf5c5eb6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:08.179508 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1a37e447-5cd0-4b1e-953a-9e8baf5c5eb6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1129 microversion: 2.1 time: 0.088125 Sep 18 00:59:08.180424 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 195/391] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:08 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1129 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:08.273125 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-afbf67d7-1b15-4198-8e80-582ef3d9280e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/os-volume_attachments/ee3d5a96-89d8-4538-b903-f4bfae8fb1a7" status: 202 len: 0 microversion: 2.1 time: 0.256954 Sep 18 00:59:08.273732 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 197/392] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 00:59:08 2022] DELETE /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/os-volume_attachments/ee3d5a96-89d8-4538-b903-f4bfae8fb1a7 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 00:59:08.512256 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:08.512776 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:08.518692 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:08.519206 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:08.519645 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:08.520334 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:08.520792 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:08.521216 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:08.648781 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:08.659170 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:08.660620 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:08.661783 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e7dad304-dd4b-4af4-9a88-d2cc9bad242b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.154175 Sep 18 00:59:08.662342 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 196/393] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:08 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:09.202577 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d810aae8-ccaf-4b0d-a278-69f2c27b1faf tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:09.203459 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d810aae8-ccaf-4b0d-a278-69f2c27b1faf tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:09.210097 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d810aae8-ccaf-4b0d-a278-69f2c27b1faf tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:09.210644 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d810aae8-ccaf-4b0d-a278-69f2c27b1faf tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:09.211134 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d810aae8-ccaf-4b0d-a278-69f2c27b1faf tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:09.211837 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d810aae8-ccaf-4b0d-a278-69f2c27b1faf tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:09.212295 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d810aae8-ccaf-4b0d-a278-69f2c27b1faf tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:09.212821 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d810aae8-ccaf-4b0d-a278-69f2c27b1faf tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:09.276678 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d810aae8-ccaf-4b0d-a278-69f2c27b1faf tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:09.284372 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d810aae8-ccaf-4b0d-a278-69f2c27b1faf tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1129 microversion: 2.1 time: 0.086028 Sep 18 00:59:09.284941 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 198/394] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:09 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1129 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:09.687133 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:09.688285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:09.694611 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:09.695358 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:09.695801 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:09.696504 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:09.697466 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:09.697902 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:09.871753 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:09.883079 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:09.884575 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:09.886090 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4e7ed6b9-4e0e-483b-be71-373875d4a33e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.203044 Sep 18 00:59:09.886998 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 197/395] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:09 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:59:10.307372 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-461401c9-ffec-4676-b9ec-a55dd9b5b8aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:10.307990 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-461401c9-ffec-4676-b9ec-a55dd9b5b8aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:10.314575 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-461401c9-ffec-4676-b9ec-a55dd9b5b8aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:10.315124 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-461401c9-ffec-4676-b9ec-a55dd9b5b8aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:10.315572 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-461401c9-ffec-4676-b9ec-a55dd9b5b8aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:10.316272 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-461401c9-ffec-4676-b9ec-a55dd9b5b8aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:10.316733 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-461401c9-ffec-4676-b9ec-a55dd9b5b8aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:10.317187 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-461401c9-ffec-4676-b9ec-a55dd9b5b8aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:10.380261 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-461401c9-ffec-4676-b9ec-a55dd9b5b8aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:10.388535 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-461401c9-ffec-4676-b9ec-a55dd9b5b8aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1185 microversion: 2.1 time: 0.085056 Sep 18 00:59:10.389110 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 199/396] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:10 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:10.458591 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c3a55fb3-1e5d-4649-9d30-54c9cf66b477 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:10.465402 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c3a55fb3-1e5d-4649-9d30-54c9cf66b477 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:10.465855 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c3a55fb3-1e5d-4649-9d30-54c9cf66b477 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:10.466295 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c3a55fb3-1e5d-4649-9d30-54c9cf66b477 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:10.525747 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c3a55fb3-1e5d-4649-9d30-54c9cf66b477 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Going to try to stop instance {{(pid=120687) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 18 00:59:10.570804 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c3a55fb3-1e5d-4649-9d30-54c9cf66b477 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "POST /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/action" status: 202 len: 0 microversion: 2.1 time: 0.115849 Sep 18 00:59:10.571440 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 198/397] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 00:59:10 2022] POST /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 00:59:10.580271 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b16b3915-47ef-47a4-b8bd-08de0982a5e7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:10.580891 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b16b3915-47ef-47a4-b8bd-08de0982a5e7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:10.586899 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b16b3915-47ef-47a4-b8bd-08de0982a5e7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:10.588485 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b16b3915-47ef-47a4-b8bd-08de0982a5e7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:10.589092 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b16b3915-47ef-47a4-b8bd-08de0982a5e7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:10.589965 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b16b3915-47ef-47a4-b8bd-08de0982a5e7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:10.590602 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b16b3915-47ef-47a4-b8bd-08de0982a5e7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:10.591221 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b16b3915-47ef-47a4-b8bd-08de0982a5e7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:10.784747 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-b16b3915-47ef-47a4-b8bd-08de0982a5e7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:10.792900 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b16b3915-47ef-47a4-b8bd-08de0982a5e7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1678 microversion: 2.1 time: 0.216478 Sep 18 00:59:10.793458 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 200/398] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:10 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:10.914401 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:10.915141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:10.921438 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:10.921927 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:10.922367 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:10.923088 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:10.923549 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:10.923975 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:11.057993 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:11.066671 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:11.068188 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:11.069342 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-90acc124-ba2d-4b1e-b0aa-efa230e946e0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.159925 Sep 18 00:59:11.069897 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 199/399] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:10 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:11.420468 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-77a271cd-2877-4c7d-b629-5741711613f9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:11.421082 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-77a271cd-2877-4c7d-b629-5741711613f9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:11.427206 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a271cd-2877-4c7d-b629-5741711613f9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:11.427691 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a271cd-2877-4c7d-b629-5741711613f9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:11.428186 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a271cd-2877-4c7d-b629-5741711613f9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:11.428810 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a271cd-2877-4c7d-b629-5741711613f9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:11.429347 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a271cd-2877-4c7d-b629-5741711613f9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:11.429779 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a271cd-2877-4c7d-b629-5741711613f9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:11.539860 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-77a271cd-2877-4c7d-b629-5741711613f9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:11.555474 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-77a271cd-2877-4c7d-b629-5741711613f9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1185 microversion: 2.1 time: 0.139620 Sep 18 00:59:11.556415 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 201/400] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:11 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:11.816549 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-2cd95a69-bed8-4a43-a4a2-153e381706b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:11.817157 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-2cd95a69-bed8-4a43-a4a2-153e381706b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:11.823816 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2cd95a69-bed8-4a43-a4a2-153e381706b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:11.824301 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2cd95a69-bed8-4a43-a4a2-153e381706b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:11.824763 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2cd95a69-bed8-4a43-a4a2-153e381706b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:11.825452 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2cd95a69-bed8-4a43-a4a2-153e381706b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:11.825910 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2cd95a69-bed8-4a43-a4a2-153e381706b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:11.826344 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2cd95a69-bed8-4a43-a4a2-153e381706b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:11.959168 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-2cd95a69-bed8-4a43-a4a2-153e381706b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:11.969880 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-2cd95a69-bed8-4a43-a4a2-153e381706b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1678 microversion: 2.1 time: 0.157050 Sep 18 00:59:11.970520 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 200/401] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:11 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:12.094632 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:12.095262 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:12.101200 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:12.101684 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:12.102117 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:12.103327 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:12.103887 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:12.104317 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:12.238276 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:12.247572 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:12.249013 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:12.250429 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-295d8efb-191a-4df5-9eab-45310d4faf0e tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.159438 Sep 18 00:59:12.251020 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 202/402] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:12 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:12.581180 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a361b66e-6476-4b66-b851-b257897ed5e7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:12.582269 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a361b66e-6476-4b66-b851-b257897ed5e7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:12.595539 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a361b66e-6476-4b66-b851-b257897ed5e7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:12.596532 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a361b66e-6476-4b66-b851-b257897ed5e7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:12.597454 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a361b66e-6476-4b66-b851-b257897ed5e7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:12.598496 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a361b66e-6476-4b66-b851-b257897ed5e7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:12.599343 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a361b66e-6476-4b66-b851-b257897ed5e7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:12.600065 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a361b66e-6476-4b66-b851-b257897ed5e7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:12.698423 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a361b66e-6476-4b66-b851-b257897ed5e7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:12.709126 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a361b66e-6476-4b66-b851-b257897ed5e7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1203 microversion: 2.1 time: 0.134026 Sep 18 00:59:12.709697 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 201/403] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:12 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1203 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:12.994075 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-5f81d4cd-b90e-40dd-91b6-4d21b0e715af tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:12.995113 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-5f81d4cd-b90e-40dd-91b6-4d21b0e715af tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:13.002586 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5f81d4cd-b90e-40dd-91b6-4d21b0e715af tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.003169 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5f81d4cd-b90e-40dd-91b6-4d21b0e715af tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.003786 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5f81d4cd-b90e-40dd-91b6-4d21b0e715af tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.004655 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5f81d4cd-b90e-40dd-91b6-4d21b0e715af tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.005312 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5f81d4cd-b90e-40dd-91b6-4d21b0e715af tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.005971 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5f81d4cd-b90e-40dd-91b6-4d21b0e715af tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.234052 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-5f81d4cd-b90e-40dd-91b6-4d21b0e715af tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:13.242595 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-5f81d4cd-b90e-40dd-91b6-4d21b0e715af tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1678 microversion: 2.1 time: 0.252805 Sep 18 00:59:13.255153 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 203/404] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:12 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1678 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:13.277452 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:13.279728 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:13.287323 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.288316 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.290053 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.291433 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.292522 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.293000 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.325316 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-71319a2c-28f5-48bc-a521-d7ccc2cfb400 req-7e56bba4-5e90-41db-82c8-b955e08f5d2d admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "c9550c04-883f-401e-8fa4-f8dc0dfc74f9", "create_info": {"type": "qcow2", "new_file": "volume-c9550c04-883f-401e-8fa4-f8dc0dfc74f9.55c46f79-51ab-45bb-8115-ae614046cbd1.vhdx", "snapshot_id": "55c46f79-51ab-45bb-8115-ae614046cbd1"}}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:13.335245 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [req-71319a2c-28f5-48bc-a521-d7ccc2cfb400 req-7e56bba4-5e90-41db-82c8-b955e08f5d2d admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb16c1c6-0d79-4315-9c36-c2a3e656bbb3(cell1) {{(pid=120687) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 18 00:59:13.335916 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-71319a2c-28f5-48bc-a521-d7ccc2cfb400 req-7e56bba4-5e90-41db-82c8-b955e08f5d2d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.336700 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-71319a2c-28f5-48bc-a521-d7ccc2cfb400 req-7e56bba4-5e90-41db-82c8-b955e08f5d2d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.337391 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-71319a2c-28f5-48bc-a521-d7ccc2cfb400 req-7e56bba4-5e90-41db-82c8-b955e08f5d2d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.379425 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-71319a2c-28f5-48bc-a521-d7ccc2cfb400 req-7e56bba4-5e90-41db-82c8-b955e08f5d2d admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.380129 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-71319a2c-28f5-48bc-a521-d7ccc2cfb400 req-7e56bba4-5e90-41db-82c8-b955e08f5d2d admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.380620 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-71319a2c-28f5-48bc-a521-d7ccc2cfb400 req-7e56bba4-5e90-41db-82c8-b955e08f5d2d admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.406535 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-71319a2c-28f5-48bc-a521-d7ccc2cfb400 req-7e56bba4-5e90-41db-82c8-b955e08f5d2d admin admin] 10.222.0.57 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.149602 Sep 18 00:59:13.407303 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 202/405] 10.222.0.57 () {64 vars in 1326 bytes} [Sun Sep 18 00:59:13 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 00:59:13.412511 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-4ac2a0b8-ccb4-4cfe-83ab-a7540e064ac2 req-d8db15f9-7206-47ed-a22d-db002ca84867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cf145a-d8d5-4a7e-937b-729bf79629fa", "name": "network-vif-plugged", "status": "completed", "tag": "3b10ed6a-bc95-40e6-afaa-4936e44594eb"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:13.423225 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-4ac2a0b8-ccb4-4cfe-83ab-a7540e064ac2 req-d8db15f9-7206-47ed-a22d-db002ca84867 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.423708 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-4ac2a0b8-ccb4-4cfe-83ab-a7540e064ac2 req-d8db15f9-7206-47ed-a22d-db002ca84867 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.424330 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-4ac2a0b8-ccb4-4cfe-83ab-a7540e064ac2 req-d8db15f9-7206-47ed-a22d-db002ca84867 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.436473 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-4ac2a0b8-ccb4-4cfe-83ab-a7540e064ac2 req-d8db15f9-7206-47ed-a22d-db002ca84867 service nova] Creating event network-vif-plugged:3b10ed6a-bc95-40e6-afaa-4936e44594eb for instance c1cf145a-d8d5-4a7e-937b-729bf79629fa on hv-cinder-maste Sep 18 00:59:13.441573 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-4ac2a0b8-ccb4-4cfe-83ab-a7540e064ac2 req-d8db15f9-7206-47ed-a22d-db002ca84867 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032795 Sep 18 00:59:13.442464 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 203/406] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:13.528173 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:13.539199 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:13.541807 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:13.543035 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e6a87ef6-7934-41a3-8649-62fcdc23e08b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.271458 Sep 18 00:59:13.543962 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 204/407] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:13 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 00:59:13.734638 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-dcd10f65-6e72-492a-bdc3-d3fdf5d4bada tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:13.735413 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-dcd10f65-6e72-492a-bdc3-d3fdf5d4bada tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:13.742015 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dcd10f65-6e72-492a-bdc3-d3fdf5d4bada tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.742658 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dcd10f65-6e72-492a-bdc3-d3fdf5d4bada tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.743131 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dcd10f65-6e72-492a-bdc3-d3fdf5d4bada tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.744576 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dcd10f65-6e72-492a-bdc3-d3fdf5d4bada tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:13.745201 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dcd10f65-6e72-492a-bdc3-d3fdf5d4bada tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:13.745823 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dcd10f65-6e72-492a-bdc3-d3fdf5d4bada tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:13.890645 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-dcd10f65-6e72-492a-bdc3-d3fdf5d4bada tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:13.898778 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-dcd10f65-6e72-492a-bdc3-d3fdf5d4bada tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1271 microversion: 2.1 time: 0.168512 Sep 18 00:59:13.899382 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 204/408] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:13 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:14.270974 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-51fb2806-b329-40fd-b8c6-f91d44c3933a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:14.271525 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-51fb2806-b329-40fd-b8c6-f91d44c3933a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:14.278601 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51fb2806-b329-40fd-b8c6-f91d44c3933a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:14.279132 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51fb2806-b329-40fd-b8c6-f91d44c3933a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:14.279571 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51fb2806-b329-40fd-b8c6-f91d44c3933a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:14.280269 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51fb2806-b329-40fd-b8c6-f91d44c3933a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:14.280728 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51fb2806-b329-40fd-b8c6-f91d44c3933a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:14.281158 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51fb2806-b329-40fd-b8c6-f91d44c3933a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:14.407463 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-51fb2806-b329-40fd-b8c6-f91d44c3933a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:14.415246 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-51fb2806-b329-40fd-b8c6-f91d44c3933a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1678 microversion: 2.1 time: 0.148234 Sep 18 00:59:14.416145 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 205/409] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:14 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:14.575824 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:14.576539 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:14.583315 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:14.583792 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:14.584223 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:14.584928 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:14.585393 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:14.585823 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:14.717916 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:14.726441 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:14.727896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:14.729119 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-21bb06da-697f-4f5a-b1f7-70751a884e86 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.158565 Sep 18 00:59:14.729675 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 205/410] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:14 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:14.922914 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-95aaf20a-096c-48f5-ad3a-3ca44bd578bc tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:14.923833 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-95aaf20a-096c-48f5-ad3a-3ca44bd578bc tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:14.930613 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-95aaf20a-096c-48f5-ad3a-3ca44bd578bc tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:14.931772 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-95aaf20a-096c-48f5-ad3a-3ca44bd578bc tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:14.932390 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-95aaf20a-096c-48f5-ad3a-3ca44bd578bc tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:14.933162 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-95aaf20a-096c-48f5-ad3a-3ca44bd578bc tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:14.933688 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-95aaf20a-096c-48f5-ad3a-3ca44bd578bc tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:14.934203 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-95aaf20a-096c-48f5-ad3a-3ca44bd578bc tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:15.134413 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-95aaf20a-096c-48f5-ad3a-3ca44bd578bc tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:15.142079 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-95aaf20a-096c-48f5-ad3a-3ca44bd578bc tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.223758 Sep 18 00:59:15.142657 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 206/411] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:14 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:15.439794 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d1ab1c72-11e0-4cad-b334-5c470a97030e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:15.440432 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d1ab1c72-11e0-4cad-b334-5c470a97030e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:15.446899 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d1ab1c72-11e0-4cad-b334-5c470a97030e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:15.447351 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d1ab1c72-11e0-4cad-b334-5c470a97030e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:15.447781 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d1ab1c72-11e0-4cad-b334-5c470a97030e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:15.448571 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d1ab1c72-11e0-4cad-b334-5c470a97030e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:15.449043 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d1ab1c72-11e0-4cad-b334-5c470a97030e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:15.449472 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d1ab1c72-11e0-4cad-b334-5c470a97030e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:15.454675 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-63b20897-ff4e-4422-bfdb-1e65b7e18c77 req-ae1b3251-08ff-4cc0-b334-c94af89587ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a39d642-1c36-48cb-909b-751208990b95", "tag": "168733ef-a9ab-4b45-b7c7-dd94d6a8994b"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:15.465852 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-63b20897-ff4e-4422-bfdb-1e65b7e18c77 req-ae1b3251-08ff-4cc0-b334-c94af89587ab service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:15.466328 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-63b20897-ff4e-4422-bfdb-1e65b7e18c77 req-ae1b3251-08ff-4cc0-b334-c94af89587ab service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:15.466754 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-63b20897-ff4e-4422-bfdb-1e65b7e18c77 req-ae1b3251-08ff-4cc0-b334-c94af89587ab service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:15.479440 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-63b20897-ff4e-4422-bfdb-1e65b7e18c77 req-ae1b3251-08ff-4cc0-b334-c94af89587ab service nova] Creating event network-changed:168733ef-a9ab-4b45-b7c7-dd94d6a8994b for instance 5a39d642-1c36-48cb-909b-751208990b95 on hv-cinder-maste Sep 18 00:59:15.484689 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-63b20897-ff4e-4422-bfdb-1e65b7e18c77 req-ae1b3251-08ff-4cc0-b334-c94af89587ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033544 Sep 18 00:59:15.485283 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 207/412] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:15.600643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d1ab1c72-11e0-4cad-b334-5c470a97030e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:15.608898 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d1ab1c72-11e0-4cad-b334-5c470a97030e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1678 microversion: 2.1 time: 0.173009 Sep 18 00:59:15.609473 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 206/413] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:15 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:15.755552 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:15.756157 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:15.763077 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:15.763650 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:15.764084 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:15.764767 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:15.765224 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:15.765642 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:15.902053 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:15.910677 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:15.912215 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:15.913375 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-50cae83e-c9ce-4fed-b9e9-8d47eff6e04a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.162094 Sep 18 00:59:15.913934 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 208/414] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:15 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:16.164791 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-48f3e09a-2738-4c74-b642-0c803b19eaf7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:16.165671 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-48f3e09a-2738-4c74-b642-0c803b19eaf7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:16.168048 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=8 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:16.174074 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48f3e09a-2738-4c74-b642-0c803b19eaf7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:16.174645 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48f3e09a-2738-4c74-b642-0c803b19eaf7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:16.175294 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48f3e09a-2738-4c74-b642-0c803b19eaf7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:16.176066 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48f3e09a-2738-4c74-b642-0c803b19eaf7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:16.176741 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48f3e09a-2738-4c74-b642-0c803b19eaf7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:16.177235 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-48f3e09a-2738-4c74-b642-0c803b19eaf7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:16.196932 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:16.579943 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-48f3e09a-2738-4c74-b642-0c803b19eaf7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:16.589217 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-48f3e09a-2738-4c74-b642-0c803b19eaf7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.428193 Sep 18 00:59:16.589911 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 207/415] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:16 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:16.633224 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7cd4b8ef-cdd1-47f1-bee6-b8b3367be141 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:16.633841 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7cd4b8ef-cdd1-47f1-bee6-b8b3367be141 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:16.640903 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7cd4b8ef-cdd1-47f1-bee6-b8b3367be141 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:16.641390 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7cd4b8ef-cdd1-47f1-bee6-b8b3367be141 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:16.641829 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7cd4b8ef-cdd1-47f1-bee6-b8b3367be141 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:16.642519 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7cd4b8ef-cdd1-47f1-bee6-b8b3367be141 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:16.643036 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7cd4b8ef-cdd1-47f1-bee6-b8b3367be141 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:16.643468 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7cd4b8ef-cdd1-47f1-bee6-b8b3367be141 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:16.774323 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7cd4b8ef-cdd1-47f1-bee6-b8b3367be141 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:16.782472 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7cd4b8ef-cdd1-47f1-bee6-b8b3367be141 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1678 microversion: 2.1 time: 0.154021 Sep 18 00:59:16.783097 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 209/416] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:16 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:16.938517 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:16.939403 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:16.946373 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:16.947805 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:16.948252 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:16.949355 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:16.949916 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:16.950355 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:17.099232 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:17.109049 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:17.110994 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:17.112362 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a7117389-b9ab-42a0-ae6e-941423e21894 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.177825 Sep 18 00:59:17.112926 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 208/417] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:16 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:17.425981 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-eed12da5-1891-42d9-9cde-c730cf0ea42f req-200b173e-755a-47b5-a229-1ee6cd82cdd5 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "c9550c04-883f-401e-8fa4-f8dc0dfc74f9", "create_info": {"type": "qcow2", "new_file": "volume-c9550c04-883f-401e-8fa4-f8dc0dfc74f9.310e4edd-81c4-411c-b01d-60c04ba825b7.vhdx", "snapshot_id": "310e4edd-81c4-411c-b01d-60c04ba825b7"}}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:17.434457 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [req-eed12da5-1891-42d9-9cde-c730cf0ea42f req-200b173e-755a-47b5-a229-1ee6cd82cdd5 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb16c1c6-0d79-4315-9c36-c2a3e656bbb3(cell1) {{(pid=120686) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 18 00:59:17.434951 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-eed12da5-1891-42d9-9cde-c730cf0ea42f req-200b173e-755a-47b5-a229-1ee6cd82cdd5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:17.435427 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-eed12da5-1891-42d9-9cde-c730cf0ea42f req-200b173e-755a-47b5-a229-1ee6cd82cdd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:17.435852 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-eed12da5-1891-42d9-9cde-c730cf0ea42f req-200b173e-755a-47b5-a229-1ee6cd82cdd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:17.474612 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-eed12da5-1891-42d9-9cde-c730cf0ea42f req-200b173e-755a-47b5-a229-1ee6cd82cdd5 admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:17.475127 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-eed12da5-1891-42d9-9cde-c730cf0ea42f req-200b173e-755a-47b5-a229-1ee6cd82cdd5 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:17.475558 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-eed12da5-1891-42d9-9cde-c730cf0ea42f req-200b173e-755a-47b5-a229-1ee6cd82cdd5 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:17.498631 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-eed12da5-1891-42d9-9cde-c730cf0ea42f req-200b173e-755a-47b5-a229-1ee6cd82cdd5 admin admin] 10.222.0.57 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.122850 Sep 18 00:59:17.499263 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 210/418] 10.222.0.57 () {64 vars in 1326 bytes} [Sun Sep 18 00:59:17 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 00:59:17.611870 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-ea416587-0572-4103-882f-5550715d0140 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:17.612392 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-ea416587-0572-4103-882f-5550715d0140 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:17.619747 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea416587-0572-4103-882f-5550715d0140 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:17.620294 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea416587-0572-4103-882f-5550715d0140 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:17.620731 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea416587-0572-4103-882f-5550715d0140 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:17.621429 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea416587-0572-4103-882f-5550715d0140 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:17.622438 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea416587-0572-4103-882f-5550715d0140 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:17.622618 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ea416587-0572-4103-882f-5550715d0140 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:17.754114 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ea416587-0572-4103-882f-5550715d0140 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:17.762420 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-ea416587-0572-4103-882f-5550715d0140 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.154810 Sep 18 00:59:17.763026 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 209/419] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:17 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:17.806929 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4d0c5102-0c81-445d-974f-2e6230ce468f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:17.807625 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-4d0c5102-0c81-445d-974f-2e6230ce468f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:17.813831 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4d0c5102-0c81-445d-974f-2e6230ce468f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:17.814321 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4d0c5102-0c81-445d-974f-2e6230ce468f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:17.814754 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4d0c5102-0c81-445d-974f-2e6230ce468f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:17.815468 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4d0c5102-0c81-445d-974f-2e6230ce468f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:17.815921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4d0c5102-0c81-445d-974f-2e6230ce468f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:17.816345 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4d0c5102-0c81-445d-974f-2e6230ce468f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:17.946319 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-4d0c5102-0c81-445d-974f-2e6230ce468f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:17.954095 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-4d0c5102-0c81-445d-974f-2e6230ce468f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1678 microversion: 2.1 time: 0.152458 Sep 18 00:59:17.954808 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 211/420] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:17 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:18.138555 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:18.139188 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:18.145063 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:18.145541 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:18.145969 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:18.146694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:18.147128 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:18.147548 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:18.284196 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:18.293492 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:18.294940 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:18.296364 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8c3b373f-45eb-4199-8a1d-c5cfcbecb2c8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.161855 Sep 18 00:59:18.297118 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 210/421] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:18 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:18.785261 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d4ef4669-2d87-4391-b2ef-5545bbfbbea7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:18.785870 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d4ef4669-2d87-4391-b2ef-5545bbfbbea7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:18.791996 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d4ef4669-2d87-4391-b2ef-5545bbfbbea7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:18.792475 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d4ef4669-2d87-4391-b2ef-5545bbfbbea7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:18.792909 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d4ef4669-2d87-4391-b2ef-5545bbfbbea7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:18.793601 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d4ef4669-2d87-4391-b2ef-5545bbfbbea7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:18.794056 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d4ef4669-2d87-4391-b2ef-5545bbfbbea7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:18.794479 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d4ef4669-2d87-4391-b2ef-5545bbfbbea7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:18.938659 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d4ef4669-2d87-4391-b2ef-5545bbfbbea7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:18.942287 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:18.948166 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d4ef4669-2d87-4391-b2ef-5545bbfbbea7 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.166765 Sep 18 00:59:18.948720 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 212/422] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:18 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:18.977341 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f6fc091f-ea02-46f4-aa9c-f4160f7d406d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:18.978525 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f6fc091f-ea02-46f4-aa9c-f4160f7d406d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:18.985190 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6fc091f-ea02-46f4-aa9c-f4160f7d406d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:18.985676 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6fc091f-ea02-46f4-aa9c-f4160f7d406d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:18.986293 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6fc091f-ea02-46f4-aa9c-f4160f7d406d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:18.987052 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6fc091f-ea02-46f4-aa9c-f4160f7d406d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:18.987710 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6fc091f-ea02-46f4-aa9c-f4160f7d406d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:18.988139 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f6fc091f-ea02-46f4-aa9c-f4160f7d406d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:19.122325 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f6fc091f-ea02-46f4-aa9c-f4160f7d406d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:19.131355 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f6fc091f-ea02-46f4-aa9c-f4160f7d406d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1678 microversion: 2.1 time: 0.157693 Sep 18 00:59:19.132094 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 211/423] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:18 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:19.326105 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:19.326925 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:19.334497 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:19.335185 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:19.335696 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:19.336405 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:19.336865 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:19.337846 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:19.467102 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:19.475704 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:19.477143 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:19.478326 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e3b2463b-628e-4b8a-859d-b25ede9f6af5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1809 microversion: 2.20 time: 0.156716 Sep 18 00:59:19.478914 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 213/424] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:19 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:19.970651 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-170c2f01-d098-47bb-a433-e0fdca4ea2c4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:19.971312 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-170c2f01-d098-47bb-a433-e0fdca4ea2c4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:19.978862 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-170c2f01-d098-47bb-a433-e0fdca4ea2c4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:19.979346 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-170c2f01-d098-47bb-a433-e0fdca4ea2c4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:19.979777 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-170c2f01-d098-47bb-a433-e0fdca4ea2c4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:19.980477 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-170c2f01-d098-47bb-a433-e0fdca4ea2c4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:19.980932 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-170c2f01-d098-47bb-a433-e0fdca4ea2c4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:19.981355 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-170c2f01-d098-47bb-a433-e0fdca4ea2c4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:20.113165 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-170c2f01-d098-47bb-a433-e0fdca4ea2c4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:20.121569 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-170c2f01-d098-47bb-a433-e0fdca4ea2c4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.154744 Sep 18 00:59:20.122129 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 212/425] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:19 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:20.157062 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-96946939-c178-4c25-9c91-31ea6b9da3a7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:20.157670 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-96946939-c178-4c25-9c91-31ea6b9da3a7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:20.164196 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96946939-c178-4c25-9c91-31ea6b9da3a7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:20.164679 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96946939-c178-4c25-9c91-31ea6b9da3a7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:20.165110 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96946939-c178-4c25-9c91-31ea6b9da3a7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:20.166538 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96946939-c178-4c25-9c91-31ea6b9da3a7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:20.167024 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96946939-c178-4c25-9c91-31ea6b9da3a7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:20.167456 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-96946939-c178-4c25-9c91-31ea6b9da3a7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:20.299556 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-96946939-c178-4c25-9c91-31ea6b9da3a7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:20.307606 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-96946939-c178-4c25-9c91-31ea6b9da3a7 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1678 microversion: 2.1 time: 0.154614 Sep 18 00:59:20.308174 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 214/426] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:20 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:20.503957 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:20.504484 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:20.511244 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:20.511733 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:20.512167 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:20.512849 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:20.513329 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:20.513753 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:20.644629 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:20.654286 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:20.655758 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:20.656898 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-acc5f96d-76d4-45db-b406-b5e21f0109f9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1796 microversion: 2.20 time: 0.157228 Sep 18 00:59:20.657447 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 213/427] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 00:59:20 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 00:59:21.144834 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-dc39298f-77c0-4446-bd60-51ba69f3327b tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:21.145441 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-dc39298f-77c0-4446-bd60-51ba69f3327b tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:21.152894 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc39298f-77c0-4446-bd60-51ba69f3327b tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:21.153452 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc39298f-77c0-4446-bd60-51ba69f3327b tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:21.154100 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc39298f-77c0-4446-bd60-51ba69f3327b tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:21.155027 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc39298f-77c0-4446-bd60-51ba69f3327b tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:21.155487 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc39298f-77c0-4446-bd60-51ba69f3327b tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:21.155907 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc39298f-77c0-4446-bd60-51ba69f3327b tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:21.292002 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-dc39298f-77c0-4446-bd60-51ba69f3327b tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:21.300093 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-dc39298f-77c0-4446-bd60-51ba69f3327b tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.159535 Sep 18 00:59:21.300657 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 215/428] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:21 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:21.330421 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8e1a208d-c442-4f21-a23e-5156fb769257 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:21.331011 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8e1a208d-c442-4f21-a23e-5156fb769257 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:21.337634 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8e1a208d-c442-4f21-a23e-5156fb769257 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:21.338044 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8e1a208d-c442-4f21-a23e-5156fb769257 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:21.338483 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8e1a208d-c442-4f21-a23e-5156fb769257 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:21.339215 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8e1a208d-c442-4f21-a23e-5156fb769257 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:21.339677 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8e1a208d-c442-4f21-a23e-5156fb769257 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:21.340108 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8e1a208d-c442-4f21-a23e-5156fb769257 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:21.467154 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8e1a208d-c442-4f21-a23e-5156fb769257 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:21.475202 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8e1a208d-c442-4f21-a23e-5156fb769257 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1678 microversion: 2.1 time: 0.148520 Sep 18 00:59:21.475761 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 214/429] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:21 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:22.322531 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-43f5e22e-01ff-4d38-9a91-ace08188def1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:22.323168 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-43f5e22e-01ff-4d38-9a91-ace08188def1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:22.329673 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43f5e22e-01ff-4d38-9a91-ace08188def1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:22.330160 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43f5e22e-01ff-4d38-9a91-ace08188def1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:22.330958 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43f5e22e-01ff-4d38-9a91-ace08188def1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:22.331305 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43f5e22e-01ff-4d38-9a91-ace08188def1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:22.331760 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43f5e22e-01ff-4d38-9a91-ace08188def1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:22.332180 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43f5e22e-01ff-4d38-9a91-ace08188def1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:22.471642 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-43f5e22e-01ff-4d38-9a91-ace08188def1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:22.479806 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-43f5e22e-01ff-4d38-9a91-ace08188def1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.161014 Sep 18 00:59:22.480396 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 216/430] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:22 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:22.499903 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-62832373-e272-4b5f-93bc-4ff07cca4915 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:22.500696 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-62832373-e272-4b5f-93bc-4ff07cca4915 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:22.508321 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62832373-e272-4b5f-93bc-4ff07cca4915 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:22.509350 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62832373-e272-4b5f-93bc-4ff07cca4915 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:22.509800 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62832373-e272-4b5f-93bc-4ff07cca4915 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:22.510781 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62832373-e272-4b5f-93bc-4ff07cca4915 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:22.511159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62832373-e272-4b5f-93bc-4ff07cca4915 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:22.511586 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-62832373-e272-4b5f-93bc-4ff07cca4915 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:22.645936 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-62832373-e272-4b5f-93bc-4ff07cca4915 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:22.654253 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-62832373-e272-4b5f-93bc-4ff07cca4915 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1655 microversion: 2.1 time: 0.159372 Sep 18 00:59:22.654990 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 215/431] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:22 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:22.678430 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-739d0f2f-e972-4580-865f-2bce1e849bde tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:22.686500 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-739d0f2f-e972-4580-865f-2bce1e849bde tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:22.687016 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-739d0f2f-e972-4580-865f-2bce1e849bde tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:22.687449 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-739d0f2f-e972-4580-865f-2bce1e849bde tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:22.710087 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-739d0f2f-e972-4580-865f-2bce1e849bde tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Going to try to start instance {{(pid=120686) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 18 00:59:22.757887 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-739d0f2f-e972-4580-865f-2bce1e849bde tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "POST /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/action" status: 202 len: 0 microversion: 2.1 time: 0.083304 Sep 18 00:59:22.758607 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 217/432] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 00:59:22 2022] POST /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 00:59:22.767289 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-29e56e13-aadb-4f23-ae96-df092275a31b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:22.768018 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-29e56e13-aadb-4f23-ae96-df092275a31b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:22.774148 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29e56e13-aadb-4f23-ae96-df092275a31b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:22.774699 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29e56e13-aadb-4f23-ae96-df092275a31b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:22.775740 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29e56e13-aadb-4f23-ae96-df092275a31b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:22.775983 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29e56e13-aadb-4f23-ae96-df092275a31b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:22.776303 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29e56e13-aadb-4f23-ae96-df092275a31b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:22.776800 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-29e56e13-aadb-4f23-ae96-df092275a31b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:22.793698 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-38d90222-dc29-404c-86b0-4e57b2994509 req-42222ead-0f74-440e-9338-39301bf8267a admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "c9550c04-883f-401e-8fa4-f8dc0dfc74f9", "create_info": {"type": "qcow2", "new_file": "volume-c9550c04-883f-401e-8fa4-f8dc0dfc74f9.7ddbd4d2-b35f-4e4a-8604-2bfb0f719c1c.vhdx", "snapshot_id": "7ddbd4d2-b35f-4e4a-8604-2bfb0f719c1c"}}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:22.797329 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-38d90222-dc29-404c-86b0-4e57b2994509 req-42222ead-0f74-440e-9338-39301bf8267a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:22.797929 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-38d90222-dc29-404c-86b0-4e57b2994509 req-42222ead-0f74-440e-9338-39301bf8267a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:22.798454 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-38d90222-dc29-404c-86b0-4e57b2994509 req-42222ead-0f74-440e-9338-39301bf8267a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:22.812236 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-38d90222-dc29-404c-86b0-4e57b2994509 req-42222ead-0f74-440e-9338-39301bf8267a admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:22.812817 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-38d90222-dc29-404c-86b0-4e57b2994509 req-42222ead-0f74-440e-9338-39301bf8267a admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:22.813314 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-38d90222-dc29-404c-86b0-4e57b2994509 req-42222ead-0f74-440e-9338-39301bf8267a admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:22.828798 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-38d90222-dc29-404c-86b0-4e57b2994509 req-42222ead-0f74-440e-9338-39301bf8267a admin admin] 10.222.0.57 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.089810 Sep 18 00:59:22.829812 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 216/433] 10.222.0.57 () {64 vars in 1326 bytes} [Sun Sep 18 00:59:22 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 18 00:59:22.920881 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-29e56e13-aadb-4f23-ae96-df092275a31b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:22.928656 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-29e56e13-aadb-4f23-ae96-df092275a31b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1664 microversion: 2.1 time: 0.165614 Sep 18 00:59:22.929236 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 218/434] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:22 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:23.503068 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b1989095-790b-45b8-8fed-9798cdd0cfe9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:23.503829 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b1989095-790b-45b8-8fed-9798cdd0cfe9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:23.510731 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b1989095-790b-45b8-8fed-9798cdd0cfe9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:23.511250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b1989095-790b-45b8-8fed-9798cdd0cfe9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:23.511687 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b1989095-790b-45b8-8fed-9798cdd0cfe9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:23.512386 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b1989095-790b-45b8-8fed-9798cdd0cfe9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:23.512852 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b1989095-790b-45b8-8fed-9798cdd0cfe9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:23.513283 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b1989095-790b-45b8-8fed-9798cdd0cfe9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:23.646612 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b1989095-790b-45b8-8fed-9798cdd0cfe9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:23.655487 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b1989095-790b-45b8-8fed-9798cdd0cfe9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.157412 Sep 18 00:59:23.656064 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 217/435] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:23 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:23.952534 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-da7ea602-3c2e-4299-b5b7-76047d92e217 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:23.953092 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-da7ea602-3c2e-4299-b5b7-76047d92e217 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:23.959648 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-da7ea602-3c2e-4299-b5b7-76047d92e217 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:23.960138 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-da7ea602-3c2e-4299-b5b7-76047d92e217 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:23.960576 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-da7ea602-3c2e-4299-b5b7-76047d92e217 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:23.961320 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-da7ea602-3c2e-4299-b5b7-76047d92e217 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:23.961810 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-da7ea602-3c2e-4299-b5b7-76047d92e217 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:23.962377 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-da7ea602-3c2e-4299-b5b7-76047d92e217 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:24.106147 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-da7ea602-3c2e-4299-b5b7-76047d92e217 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:24.115722 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-da7ea602-3c2e-4299-b5b7-76047d92e217 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1664 microversion: 2.1 time: 0.167094 Sep 18 00:59:24.133963 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 219/436] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:23 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1664 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:24.678518 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c2070fe3-8a38-473d-b509-b6a96fb51b28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:24.679268 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c2070fe3-8a38-473d-b509-b6a96fb51b28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:24.682385 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:24.688371 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c2070fe3-8a38-473d-b509-b6a96fb51b28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:24.688859 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c2070fe3-8a38-473d-b509-b6a96fb51b28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:24.689319 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c2070fe3-8a38-473d-b509-b6a96fb51b28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:24.690275 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c2070fe3-8a38-473d-b509-b6a96fb51b28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:24.690941 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c2070fe3-8a38-473d-b509-b6a96fb51b28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:24.691369 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c2070fe3-8a38-473d-b509-b6a96fb51b28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:24.832449 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c2070fe3-8a38-473d-b509-b6a96fb51b28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:24.840258 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c2070fe3-8a38-473d-b509-b6a96fb51b28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.165434 Sep 18 00:59:24.840836 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 218/437] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:24 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:25.141724 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-5ba4d552-df7f-4c2a-ae10-ed115ee6076a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:25.142345 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-5ba4d552-df7f-4c2a-ae10-ed115ee6076a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:25.149672 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5ba4d552-df7f-4c2a-ae10-ed115ee6076a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:25.150277 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5ba4d552-df7f-4c2a-ae10-ed115ee6076a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:25.150718 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5ba4d552-df7f-4c2a-ae10-ed115ee6076a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:25.151447 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5ba4d552-df7f-4c2a-ae10-ed115ee6076a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:25.151911 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5ba4d552-df7f-4c2a-ae10-ed115ee6076a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:25.152341 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5ba4d552-df7f-4c2a-ae10-ed115ee6076a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:25.281787 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-5ba4d552-df7f-4c2a-ae10-ed115ee6076a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:25.291559 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-5ba4d552-df7f-4c2a-ae10-ed115ee6076a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1664 microversion: 2.1 time: 0.153627 Sep 18 00:59:25.292257 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 220/438] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:25 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:25.431034 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-9110fdb2-e95b-4847-a780-87eaea138ba7 req-13a49c04-9e3b-4d10-916e-38e44b393c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a39d642-1c36-48cb-909b-751208990b95", "name": "network-vif-plugged", "status": "completed", "tag": "168733ef-a9ab-4b45-b7c7-dd94d6a8994b"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:25.440594 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-9110fdb2-e95b-4847-a780-87eaea138ba7 req-13a49c04-9e3b-4d10-916e-38e44b393c16 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:25.440855 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-9110fdb2-e95b-4847-a780-87eaea138ba7 req-13a49c04-9e3b-4d10-916e-38e44b393c16 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:25.441287 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-9110fdb2-e95b-4847-a780-87eaea138ba7 req-13a49c04-9e3b-4d10-916e-38e44b393c16 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:25.452966 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-9110fdb2-e95b-4847-a780-87eaea138ba7 req-13a49c04-9e3b-4d10-916e-38e44b393c16 service nova] Creating event network-vif-plugged:168733ef-a9ab-4b45-b7c7-dd94d6a8994b for instance 5a39d642-1c36-48cb-909b-751208990b95 on hv-cinder-maste Sep 18 00:59:25.457700 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-9110fdb2-e95b-4847-a780-87eaea138ba7 req-13a49c04-9e3b-4d10-916e-38e44b393c16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030405 Sep 18 00:59:25.458402 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 219/439] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:25.864134 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-52b8ac0a-d00f-41c4-8fb1-dedce3dd2f2a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:25.864847 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-52b8ac0a-d00f-41c4-8fb1-dedce3dd2f2a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:25.871313 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-52b8ac0a-d00f-41c4-8fb1-dedce3dd2f2a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:25.871792 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-52b8ac0a-d00f-41c4-8fb1-dedce3dd2f2a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:25.872228 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-52b8ac0a-d00f-41c4-8fb1-dedce3dd2f2a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:25.872920 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-52b8ac0a-d00f-41c4-8fb1-dedce3dd2f2a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:25.873373 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-52b8ac0a-d00f-41c4-8fb1-dedce3dd2f2a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:25.873797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-52b8ac0a-d00f-41c4-8fb1-dedce3dd2f2a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:25.897141 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-14de6e4a-e609-413e-82d5-840cac844d66 req-f2a63bd9-5d4a-400a-a071-b4ff96647e3d admin admin] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:25.901027 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-14de6e4a-e609-413e-82d5-840cac844d66 req-f2a63bd9-5d4a-400a-a071-b4ff96647e3d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:25.901568 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-14de6e4a-e609-413e-82d5-840cac844d66 req-f2a63bd9-5d4a-400a-a071-b4ff96647e3d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:25.901965 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-14de6e4a-e609-413e-82d5-840cac844d66 req-f2a63bd9-5d4a-400a-a071-b4ff96647e3d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:25.910164 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-14de6e4a-e609-413e-82d5-840cac844d66 req-f2a63bd9-5d4a-400a-a071-b4ff96647e3d admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:25.910638 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-14de6e4a-e609-413e-82d5-840cac844d66 req-f2a63bd9-5d4a-400a-a071-b4ff96647e3d admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:25.911092 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-14de6e4a-e609-413e-82d5-840cac844d66 req-f2a63bd9-5d4a-400a-a071-b4ff96647e3d admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:25.925046 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-14de6e4a-e609-413e-82d5-840cac844d66 req-f2a63bd9-5d4a-400a-a071-b4ff96647e3d admin admin] 10.222.0.57 "DELETE /compute/v2.1/os-assisted-volume-snapshots/55c46f79-51ab-45bb-8115-ae614046cbd1?delete_info=%7B%22file_to_merge%22:%20%22volume-c9550c04-883f-401e-8fa4-f8dc0dfc74f9.55c46f79-51ab-45bb-8115-ae614046cbd1.vhdx%22,%20%22volume_id%22:%20%22c9550c04-883f-401e-8fa4-f8dc0dfc74f9%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.077830 Sep 18 00:59:25.925628 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 221/440] 10.222.0.57 () {62 vars in 1800 bytes} [Sun Sep 18 00:59:25 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/55c46f79-51ab-45bb-8115-ae614046cbd1?delete_info=%7B%22file_to_merge%22:%20%22volume-c9550c04-883f-401e-8fa4-f8dc0dfc74f9.55c46f79-51ab-45bb-8115-ae614046cbd1.vhdx%22,%20%22volume_id%22:%20%22c9550c04-883f-401e-8fa4-f8dc0dfc74f9%22%7D => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 00:59:26.010489 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-52b8ac0a-d00f-41c4-8fb1-dedce3dd2f2a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:26.018300 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-52b8ac0a-d00f-41c4-8fb1-dedce3dd2f2a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.158812 Sep 18 00:59:26.018922 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 220/441] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:25 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:26.315594 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3624d7f7-9cac-49eb-8c6f-966e9627c0db tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:26.316205 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3624d7f7-9cac-49eb-8c6f-966e9627c0db tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:26.322909 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3624d7f7-9cac-49eb-8c6f-966e9627c0db tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:26.323411 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3624d7f7-9cac-49eb-8c6f-966e9627c0db tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:26.323828 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3624d7f7-9cac-49eb-8c6f-966e9627c0db tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:26.324516 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3624d7f7-9cac-49eb-8c6f-966e9627c0db tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:26.324968 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3624d7f7-9cac-49eb-8c6f-966e9627c0db tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:26.325389 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3624d7f7-9cac-49eb-8c6f-966e9627c0db tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:26.454263 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3624d7f7-9cac-49eb-8c6f-966e9627c0db tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:26.462547 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3624d7f7-9cac-49eb-8c6f-966e9627c0db tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1664 microversion: 2.1 time: 0.151119 Sep 18 00:59:26.463165 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 222/442] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:26 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:27.042690 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-13bd5f6a-0f6f-440a-b393-bf2233fe4669 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:27.043328 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-13bd5f6a-0f6f-440a-b393-bf2233fe4669 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:27.049702 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-13bd5f6a-0f6f-440a-b393-bf2233fe4669 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:27.050199 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-13bd5f6a-0f6f-440a-b393-bf2233fe4669 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:27.050615 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-13bd5f6a-0f6f-440a-b393-bf2233fe4669 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:27.051337 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-13bd5f6a-0f6f-440a-b393-bf2233fe4669 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:27.051792 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-13bd5f6a-0f6f-440a-b393-bf2233fe4669 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:27.052215 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-13bd5f6a-0f6f-440a-b393-bf2233fe4669 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:27.184225 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-13bd5f6a-0f6f-440a-b393-bf2233fe4669 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:27.194337 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-13bd5f6a-0f6f-440a-b393-bf2233fe4669 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.156168 Sep 18 00:59:27.194968 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 221/443] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:27 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:27.485536 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c93ae70a-8294-48a5-aa6f-85cc8e51b124 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:27.486366 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c93ae70a-8294-48a5-aa6f-85cc8e51b124 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:27.493341 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c93ae70a-8294-48a5-aa6f-85cc8e51b124 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:27.493833 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c93ae70a-8294-48a5-aa6f-85cc8e51b124 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:27.494265 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c93ae70a-8294-48a5-aa6f-85cc8e51b124 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:27.495013 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c93ae70a-8294-48a5-aa6f-85cc8e51b124 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:27.495469 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c93ae70a-8294-48a5-aa6f-85cc8e51b124 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:27.495916 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c93ae70a-8294-48a5-aa6f-85cc8e51b124 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:27.623868 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c93ae70a-8294-48a5-aa6f-85cc8e51b124 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:27.631763 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c93ae70a-8294-48a5-aa6f-85cc8e51b124 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1668 microversion: 2.1 time: 0.150174 Sep 18 00:59:27.632352 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 223/444] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:27 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:28.218205 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-6b31ed7f-122f-4c00-9868-01c12c9dfbf3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:28.218839 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-6b31ed7f-122f-4c00-9868-01c12c9dfbf3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:28.225233 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6b31ed7f-122f-4c00-9868-01c12c9dfbf3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:28.225710 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6b31ed7f-122f-4c00-9868-01c12c9dfbf3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:28.226138 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6b31ed7f-122f-4c00-9868-01c12c9dfbf3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:28.226834 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6b31ed7f-122f-4c00-9868-01c12c9dfbf3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:28.227502 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6b31ed7f-122f-4c00-9868-01c12c9dfbf3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:28.228169 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6b31ed7f-122f-4c00-9868-01c12c9dfbf3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:28.358093 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-6b31ed7f-122f-4c00-9868-01c12c9dfbf3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:28.365827 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-6b31ed7f-122f-4c00-9868-01c12c9dfbf3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.151483 Sep 18 00:59:28.366386 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 222/445] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:28 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:28.653426 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d73903f2-07de-477e-83f5-e7a7ae0aadd6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:28.653962 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d73903f2-07de-477e-83f5-e7a7ae0aadd6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:28.660406 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d73903f2-07de-477e-83f5-e7a7ae0aadd6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:28.660933 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d73903f2-07de-477e-83f5-e7a7ae0aadd6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:28.661366 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d73903f2-07de-477e-83f5-e7a7ae0aadd6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:28.662127 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d73903f2-07de-477e-83f5-e7a7ae0aadd6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:28.662581 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d73903f2-07de-477e-83f5-e7a7ae0aadd6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:28.663096 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d73903f2-07de-477e-83f5-e7a7ae0aadd6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:28.689184 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d73903f2-07de-477e-83f5-e7a7ae0aadd6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b/ips" status: 200 len: 149 microversion: 2.1 time: 0.039764 Sep 18 00:59:28.689745 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 224/446] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 18 00:59:28 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:28.702336 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4e26bcf-e563-4680-a110-a4144a0272d5"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:28.704717 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:28.710630 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:28.711148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:28.711753 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:28.712439 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:28.712895 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:28.713319 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:28.796086 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Invalid volume: volume e4e26bcf-e563-4680-a110-a4144a0272d5 is already attached to instances: e2055882-050f-4acf-a99c-96d698e25963 Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: POST /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b/os-volume_attachments HTTP/1.1 Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 74 Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 00:59:28.797873 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: {"volumeAttachment": {"volumeId": "e4e26bcf-e563-4680-a110-a4144a0272d5"}} Sep 18 00:59:28.799265 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Invalid volume: volume e4e26bcf-e563-4680-a110-a4144a0272d5 is already attached to instances: e2055882-050f-4acf-a99c-96d698e25963 Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'server_id': 'b142dfeb-6de9-4d35-9b1e-b0545715235b', 'body': {'volumeAttachment': {'volumeId': 'e4e26bcf-e563-4680-a110-a4144a0272d5'}}} Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e4e26bcf-e563-4680-a110-a4144a0272d5 is already attached to instances: e2055882-050f-4acf-a99c-96d698e25963 Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:28.804877 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e4e26bcf-e563-4680-a110-a4144a0272d5 is already attached to instances: e2055882-050f-4acf-a99c-96d698e25963 Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:28.806729 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:59:28.809581 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:59:28.809581 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:59:28.809581 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:59:28.809581 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e4e26bcf-e563-4680-a110-a4144a0272d5 is already attached to instances: e2055882-050f-4acf-a99c-96d698e25963 Sep 18 00:59:28.809581 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:28.809581 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 400 to user: Invalid volume: volume e4e26bcf-e563-4680-a110-a4144a0272d5 is already attached to instances: e2055882-050f-4acf-a99c-96d698e25963 {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:59:28.809581 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-2bae3039-41ba-40c2-b999-3feaa5ce21a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100994 Sep 18 00:59:28.809581 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 223/447] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 00:59:28 2022] POST /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 00:59:28.810569 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e5dfcc8f-cd00-43f3-9734-68771e343eae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:28.810569 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e5dfcc8f-cd00-43f3-9734-68771e343eae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:28.816118 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5dfcc8f-cd00-43f3-9734-68771e343eae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:28.816610 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5dfcc8f-cd00-43f3-9734-68771e343eae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:28.817049 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5dfcc8f-cd00-43f3-9734-68771e343eae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:28.817753 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5dfcc8f-cd00-43f3-9734-68771e343eae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:28.818264 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5dfcc8f-cd00-43f3-9734-68771e343eae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:28.818729 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e5dfcc8f-cd00-43f3-9734-68771e343eae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:28.845826 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e5dfcc8f-cd00-43f3-9734-68771e343eae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Going to try to terminate instance {{(pid=120686) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 00:59:28.923037 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e5dfcc8f-cd00-43f3-9734-68771e343eae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 204 len: 0 microversion: 2.1 time: 0.117702 Sep 18 00:59:28.923765 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 225/448] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 00:59:28 2022] DELETE /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 00:59:28.932613 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8827dc00-cdc2-49b7-b787-5a278c9895a3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:28.933257 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8827dc00-cdc2-49b7-b787-5a278c9895a3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:28.942612 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8827dc00-cdc2-49b7-b787-5a278c9895a3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:28.943145 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8827dc00-cdc2-49b7-b787-5a278c9895a3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:28.943604 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8827dc00-cdc2-49b7-b787-5a278c9895a3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:28.944310 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8827dc00-cdc2-49b7-b787-5a278c9895a3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:28.944773 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8827dc00-cdc2-49b7-b787-5a278c9895a3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:28.945203 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8827dc00-cdc2-49b7-b787-5a278c9895a3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:29.076242 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8827dc00-cdc2-49b7-b787-5a278c9895a3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:29.083836 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8827dc00-cdc2-49b7-b787-5a278c9895a3 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1681 microversion: 2.1 time: 0.155516 Sep 18 00:59:29.084422 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 224/449] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:28 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:29.398979 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4f98fb12-8047-4ef3-913a-26b7c8f367e5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:29.399716 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-4f98fb12-8047-4ef3-913a-26b7c8f367e5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:29.406437 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4f98fb12-8047-4ef3-913a-26b7c8f367e5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:29.406966 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4f98fb12-8047-4ef3-913a-26b7c8f367e5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:29.407408 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4f98fb12-8047-4ef3-913a-26b7c8f367e5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:29.408102 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4f98fb12-8047-4ef3-913a-26b7c8f367e5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:29.408560 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4f98fb12-8047-4ef3-913a-26b7c8f367e5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:29.409000 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4f98fb12-8047-4ef3-913a-26b7c8f367e5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:29.544932 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-4f98fb12-8047-4ef3-913a-26b7c8f367e5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:29.552546 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-4f98fb12-8047-4ef3-913a-26b7c8f367e5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1259 microversion: 2.1 time: 0.157796 Sep 18 00:59:29.553109 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 226/450] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:29 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:30.108099 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-58f122fd-9f01-4d0c-9d6e-79ed73ce00b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:30.108726 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-58f122fd-9f01-4d0c-9d6e-79ed73ce00b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:30.115180 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-58f122fd-9f01-4d0c-9d6e-79ed73ce00b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:30.115727 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-58f122fd-9f01-4d0c-9d6e-79ed73ce00b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:30.116164 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-58f122fd-9f01-4d0c-9d6e-79ed73ce00b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:30.116916 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-58f122fd-9f01-4d0c-9d6e-79ed73ce00b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:30.117375 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-58f122fd-9f01-4d0c-9d6e-79ed73ce00b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:30.117803 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-58f122fd-9f01-4d0c-9d6e-79ed73ce00b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:30.133778 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=100 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:30.254012 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-58f122fd-9f01-4d0c-9d6e-79ed73ce00b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:30.263133 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-58f122fd-9f01-4d0c-9d6e-79ed73ce00b6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1681 microversion: 2.1 time: 0.158822 Sep 18 00:59:30.263786 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 225/451] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:30 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:30.575796 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c2f14dc0-29b8-4405-b3dc-dc350f3e9250 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:30.576417 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c2f14dc0-29b8-4405-b3dc-dc350f3e9250 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:30.583109 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2f14dc0-29b8-4405-b3dc-dc350f3e9250 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:30.583585 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2f14dc0-29b8-4405-b3dc-dc350f3e9250 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:30.584017 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2f14dc0-29b8-4405-b3dc-dc350f3e9250 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:30.584794 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2f14dc0-29b8-4405-b3dc-dc350f3e9250 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:30.585245 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2f14dc0-29b8-4405-b3dc-dc350f3e9250 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:30.585663 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2f14dc0-29b8-4405-b3dc-dc350f3e9250 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:30.717936 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c2f14dc0-29b8-4405-b3dc-dc350f3e9250 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:30.721478 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:30.726739 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c2f14dc0-29b8-4405-b3dc-dc350f3e9250 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1443 microversion: 2.1 time: 0.155025 Sep 18 00:59:30.727330 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 227/452] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:30 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:30.748881 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8c48c952-e5b9-4e4a-ad99-2c0aba2c0d95 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:30.749742 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8c48c952-e5b9-4e4a-ad99-2c0aba2c0d95 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:30.755627 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c48c952-e5b9-4e4a-ad99-2c0aba2c0d95 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:30.756106 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c48c952-e5b9-4e4a-ad99-2c0aba2c0d95 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:30.756535 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c48c952-e5b9-4e4a-ad99-2c0aba2c0d95 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:30.757213 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c48c952-e5b9-4e4a-ad99-2c0aba2c0d95 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:30.757710 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c48c952-e5b9-4e4a-ad99-2c0aba2c0d95 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:30.758203 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8c48c952-e5b9-4e4a-ad99-2c0aba2c0d95 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:30.894682 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8c48c952-e5b9-4e4a-ad99-2c0aba2c0d95 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:30.903168 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8c48c952-e5b9-4e4a-ad99-2c0aba2c0d95 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1443 microversion: 2.1 time: 0.158010 Sep 18 00:59:30.903742 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 226/453] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:30 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:31.112913 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-3001fa9d-98ca-4193-bda4-185f7af06c89 req-89ea2b12-98a6-4979-8f4e-2174994aac36 admin admin] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:31.116353 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-3001fa9d-98ca-4193-bda4-185f7af06c89 req-89ea2b12-98a6-4979-8f4e-2174994aac36 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:31.116866 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-3001fa9d-98ca-4193-bda4-185f7af06c89 req-89ea2b12-98a6-4979-8f4e-2174994aac36 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:31.117300 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-3001fa9d-98ca-4193-bda4-185f7af06c89 req-89ea2b12-98a6-4979-8f4e-2174994aac36 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:31.126270 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-3001fa9d-98ca-4193-bda4-185f7af06c89 req-89ea2b12-98a6-4979-8f4e-2174994aac36 admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:31.126755 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-3001fa9d-98ca-4193-bda4-185f7af06c89 req-89ea2b12-98a6-4979-8f4e-2174994aac36 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:31.127219 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-3001fa9d-98ca-4193-bda4-185f7af06c89 req-89ea2b12-98a6-4979-8f4e-2174994aac36 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:31.141603 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-3001fa9d-98ca-4193-bda4-185f7af06c89 req-89ea2b12-98a6-4979-8f4e-2174994aac36 admin admin] 10.222.0.57 "DELETE /compute/v2.1/os-assisted-volume-snapshots/7ddbd4d2-b35f-4e4a-8604-2bfb0f719c1c?delete_info=%7B%22file_to_merge%22:%20%22volume-c9550c04-883f-401e-8fa4-f8dc0dfc74f9.7ddbd4d2-b35f-4e4a-8604-2bfb0f719c1c.vhdx%22,%20%22volume_id%22:%20%22c9550c04-883f-401e-8fa4-f8dc0dfc74f9%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.079595 Sep 18 00:59:31.142214 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 228/454] 10.222.0.57 () {62 vars in 1800 bytes} [Sun Sep 18 00:59:31 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/7ddbd4d2-b35f-4e4a-8604-2bfb0f719c1c?delete_info=%7B%22file_to_merge%22:%20%22volume-c9550c04-883f-401e-8fa4-f8dc0dfc74f9.7ddbd4d2-b35f-4e4a-8604-2bfb0f719c1c.vhdx%22,%20%22volume_id%22:%20%22c9550c04-883f-401e-8fa4-f8dc0dfc74f9%22%7D => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 00:59:31.287444 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5497eb4f-efd4-45d3-adf2-bf304501c5d5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:31.288053 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5497eb4f-efd4-45d3-adf2-bf304501c5d5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:31.294799 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5497eb4f-efd4-45d3-adf2-bf304501c5d5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:31.295306 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5497eb4f-efd4-45d3-adf2-bf304501c5d5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:31.295737 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5497eb4f-efd4-45d3-adf2-bf304501c5d5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:31.296431 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5497eb4f-efd4-45d3-adf2-bf304501c5d5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:31.296881 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5497eb4f-efd4-45d3-adf2-bf304501c5d5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:31.297301 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5497eb4f-efd4-45d3-adf2-bf304501c5d5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:31.481784 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5497eb4f-efd4-45d3-adf2-bf304501c5d5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:31.489604 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5497eb4f-efd4-45d3-adf2-bf304501c5d5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1681 microversion: 2.1 time: 0.206022 Sep 18 00:59:31.490186 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 227/455] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:31 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:32.515825 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4b5c6a5d-3779-40a6-ac99-e18f6ff4e7e0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:32.516516 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-4b5c6a5d-3779-40a6-ac99-e18f6ff4e7e0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:32.522657 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b5c6a5d-3779-40a6-ac99-e18f6ff4e7e0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:32.523174 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b5c6a5d-3779-40a6-ac99-e18f6ff4e7e0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:32.523613 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b5c6a5d-3779-40a6-ac99-e18f6ff4e7e0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:32.524305 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b5c6a5d-3779-40a6-ac99-e18f6ff4e7e0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:32.524764 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b5c6a5d-3779-40a6-ac99-e18f6ff4e7e0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:32.525677 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b5c6a5d-3779-40a6-ac99-e18f6ff4e7e0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:32.651018 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-9ec5c771-3203-4061-8eeb-14cc3398f712 req-39867330-b9f7-49b6-a630-07916bba8c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a39d642-1c36-48cb-909b-751208990b95", "tag": "168733ef-a9ab-4b45-b7c7-dd94d6a8994b"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:32.661603 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-9ec5c771-3203-4061-8eeb-14cc3398f712 req-39867330-b9f7-49b6-a630-07916bba8c66 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:32.662244 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-9ec5c771-3203-4061-8eeb-14cc3398f712 req-39867330-b9f7-49b6-a630-07916bba8c66 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:32.662672 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-9ec5c771-3203-4061-8eeb-14cc3398f712 req-39867330-b9f7-49b6-a630-07916bba8c66 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:32.673968 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-9ec5c771-3203-4061-8eeb-14cc3398f712 req-39867330-b9f7-49b6-a630-07916bba8c66 service nova] Creating event network-changed:168733ef-a9ab-4b45-b7c7-dd94d6a8994b for instance 5a39d642-1c36-48cb-909b-751208990b95 on hv-cinder-maste Sep 18 00:59:32.679561 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-9ec5c771-3203-4061-8eeb-14cc3398f712 req-39867330-b9f7-49b6-a630-07916bba8c66 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032328 Sep 18 00:59:32.680509 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 228/456] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:59:32.693793 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-4b5c6a5d-3779-40a6-ac99-e18f6ff4e7e0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:32.702265 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-4b5c6a5d-3779-40a6-ac99-e18f6ff4e7e0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1681 microversion: 2.1 time: 0.191288 Sep 18 00:59:32.703118 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 229/457] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:32 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:33.722306 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=6 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:33.728201 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-31569985-f309-427c-97ff-71c8798a1ce6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:33.728908 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-31569985-f309-427c-97ff-71c8798a1ce6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:33.735469 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31569985-f309-427c-97ff-71c8798a1ce6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:33.735950 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31569985-f309-427c-97ff-71c8798a1ce6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:33.736383 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31569985-f309-427c-97ff-71c8798a1ce6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:33.737072 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31569985-f309-427c-97ff-71c8798a1ce6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:33.737529 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31569985-f309-427c-97ff-71c8798a1ce6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:33.737952 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-31569985-f309-427c-97ff-71c8798a1ce6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:33.867527 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-31569985-f309-427c-97ff-71c8798a1ce6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:33.875685 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-31569985-f309-427c-97ff-71c8798a1ce6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1681 microversion: 2.1 time: 0.154261 Sep 18 00:59:33.876256 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 229/458] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:33 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:34.323336 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-029988f6-bb0d-4f6e-8527-e3b36c087552 req-2b0a2740-3e38-487d-8a78-7757d1cb2759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b142dfeb-6de9-4d35-9b1e-b0545715235b", "name": "network-vif-deleted", "tag": "52a424bc-9fbd-479c-b108-af4ee47377ab"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:34.345837 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-029988f6-bb0d-4f6e-8527-e3b36c087552 req-2b0a2740-3e38-487d-8a78-7757d1cb2759 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:34.346582 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-029988f6-bb0d-4f6e-8527-e3b36c087552 req-2b0a2740-3e38-487d-8a78-7757d1cb2759 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:34.347034 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-029988f6-bb0d-4f6e-8527-e3b36c087552 req-2b0a2740-3e38-487d-8a78-7757d1cb2759 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:34.359699 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-029988f6-bb0d-4f6e-8527-e3b36c087552 req-2b0a2740-3e38-487d-8a78-7757d1cb2759 service nova] Creating event network-vif-deleted:52a424bc-9fbd-479c-b108-af4ee47377ab for instance b142dfeb-6de9-4d35-9b1e-b0545715235b on hv-cinder-maste Sep 18 00:59:34.365133 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-029988f6-bb0d-4f6e-8527-e3b36c087552 req-2b0a2740-3e38-487d-8a78-7757d1cb2759 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046820 Sep 18 00:59:34.366783 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 230/459] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:34.900954 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:34.902633 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:34.924904 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:34.925685 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:34.926655 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:34.927744 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:34.928367 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:34.930115 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:35.001311 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:35.002038 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:35.003066 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:35.003679 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lazy-loading 'fault' on Instance uuid b142dfeb-6de9-4d35-9b1e-b0545715235b {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:59:35.056746 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:35.071562 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0abf643e-77e1-4ad7-87cb-5e155386f2a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 200 len: 1331 microversion: 2.1 time: 0.175105 Sep 18 00:59:35.072836 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 230/460] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:34 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 1331 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:36.097450 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:36.098220 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:36.100171 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:36.107288 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:36.107778 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:36.108210 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:36.108904 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:36.109356 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:36.109777 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:36.124842 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b HTTP/1.1 Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 00:59:36.126483 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 00:59:36.128136 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'b142dfeb-6de9-4d35-9b1e-b0545715235b'} Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:59:36.129000 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 00:59:36.130293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 00:59:36.131440 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:59:36.131440 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-54d4db52-2cfe-4c4d-837a-d9ef4ac6b535 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 404 len: 111 microversion: 2.1 time: 0.035546 Sep 18 00:59:36.131440 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 231/461] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:36 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 00:59:36.137421 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-71a5a248-56cd-4c07-ac6e-57930e4d8162 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '.version_select at 0x7f5672b99f70>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:36.158572 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-71a5a248-56cd-4c07-ac6e-57930e4d8162 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1954630842" status: 202 len: 0 microversion: 2.1 time: 0.025349 Sep 18 00:59:36.159584 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 231/462] 10.222.0.33 () {58 vars in 1221 bytes} [Sun Sep 18 00:59:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1954630842 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 00:59:36.376328 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-78182511-3337-4cab-bd02-9660c6940ede req-21d9ae03-eb2a-4522-8af6-e4ab4dc42af1 admin admin] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:36.379855 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-78182511-3337-4cab-bd02-9660c6940ede req-21d9ae03-eb2a-4522-8af6-e4ab4dc42af1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:36.380614 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-78182511-3337-4cab-bd02-9660c6940ede req-21d9ae03-eb2a-4522-8af6-e4ab4dc42af1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:36.381053 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-78182511-3337-4cab-bd02-9660c6940ede req-21d9ae03-eb2a-4522-8af6-e4ab4dc42af1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:36.392178 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-78182511-3337-4cab-bd02-9660c6940ede req-21d9ae03-eb2a-4522-8af6-e4ab4dc42af1 admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:36.392681 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-78182511-3337-4cab-bd02-9660c6940ede req-21d9ae03-eb2a-4522-8af6-e4ab4dc42af1 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:36.393116 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-78182511-3337-4cab-bd02-9660c6940ede req-21d9ae03-eb2a-4522-8af6-e4ab4dc42af1 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:36.406755 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-78182511-3337-4cab-bd02-9660c6940ede req-21d9ae03-eb2a-4522-8af6-e4ab4dc42af1 admin admin] 10.222.0.57 "DELETE /compute/v2.1/os-assisted-volume-snapshots/310e4edd-81c4-411c-b01d-60c04ba825b7?delete_info=%7B%22file_to_merge%22:%20%22volume-c9550c04-883f-401e-8fa4-f8dc0dfc74f9.310e4edd-81c4-411c-b01d-60c04ba825b7.vhdx%22,%20%22volume_id%22:%20%22c9550c04-883f-401e-8fa4-f8dc0dfc74f9%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.105433 Sep 18 00:59:36.407381 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 232/463] 10.222.0.57 () {62 vars in 1800 bytes} [Sun Sep 18 00:59:36 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/310e4edd-81c4-411c-b01d-60c04ba825b7?delete_info=%7B%22file_to_merge%22:%20%22volume-c9550c04-883f-401e-8fa4-f8dc0dfc74f9.310e4edd-81c4-411c-b01d-60c04ba825b7.vhdx%22,%20%22volume_id%22:%20%22c9550c04-883f-401e-8fa4-f8dc0dfc74f9%22%7D => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 00:59:36.858413 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9647534c-0bcf-4a11-beae-096a99957ce1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:36.858949 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9647534c-0bcf-4a11-beae-096a99957ce1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:36.867542 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9647534c-0bcf-4a11-beae-096a99957ce1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:36.868031 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9647534c-0bcf-4a11-beae-096a99957ce1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:36.868524 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9647534c-0bcf-4a11-beae-096a99957ce1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:36.869191 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9647534c-0bcf-4a11-beae-096a99957ce1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:36.869650 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9647534c-0bcf-4a11-beae-096a99957ce1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:36.870077 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9647534c-0bcf-4a11-beae-096a99957ce1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:36.995841 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-9647534c-0bcf-4a11-beae-096a99957ce1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lazy-loading 'services' on Instance uuid e2055882-050f-4acf-a99c-96d698e25963 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:59:37.117014 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9647534c-0bcf-4a11-beae-096a99957ce1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-volume_attachments/e4e26bcf-e563-4680-a110-a4144a0272d5" status: 202 len: 0 microversion: 2.1 time: 0.262372 Sep 18 00:59:37.117595 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 232/464] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 00:59:36 2022] DELETE /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-volume_attachments/e4e26bcf-e563-4680-a110-a4144a0272d5 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 00:59:37.128002 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-287d2f78-8e3a-4039-b9c2-ee366d69e656 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:37.130242 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-287d2f78-8e3a-4039-b9c2-ee366d69e656 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:37.137197 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-287d2f78-8e3a-4039-b9c2-ee366d69e656 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:37.137680 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-287d2f78-8e3a-4039-b9c2-ee366d69e656 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:37.138116 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-287d2f78-8e3a-4039-b9c2-ee366d69e656 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:37.138826 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-287d2f78-8e3a-4039-b9c2-ee366d69e656 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:37.139283 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-287d2f78-8e3a-4039-b9c2-ee366d69e656 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:37.139706 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-287d2f78-8e3a-4039-b9c2-ee366d69e656 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:37.168565 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-287d2f78-8e3a-4039-b9c2-ee366d69e656 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045754 Sep 18 00:59:37.169111 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 233/465] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 00:59:37 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:38.182395 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-ab2ed8d6-21cd-43e2-aafe-d0b0ace07151 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:38.184743 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-ab2ed8d6-21cd-43e2-aafe-d0b0ace07151 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:38.190979 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ab2ed8d6-21cd-43e2-aafe-d0b0ace07151 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:38.191464 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ab2ed8d6-21cd-43e2-aafe-d0b0ace07151 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:38.191902 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ab2ed8d6-21cd-43e2-aafe-d0b0ace07151 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:38.192586 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ab2ed8d6-21cd-43e2-aafe-d0b0ace07151 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:38.193040 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ab2ed8d6-21cd-43e2-aafe-d0b0ace07151 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:38.193460 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ab2ed8d6-21cd-43e2-aafe-d0b0ace07151 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:38.224173 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-ab2ed8d6-21cd-43e2-aafe-d0b0ace07151 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046980 Sep 18 00:59:38.224643 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 233/466] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 00:59:38 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:39.237746 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a0fc096e-0d2a-47b1-826e-b60a8e339b05 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:39.239853 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-a0fc096e-0d2a-47b1-826e-b60a8e339b05 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:39.246710 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a0fc096e-0d2a-47b1-826e-b60a8e339b05 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:39.247257 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a0fc096e-0d2a-47b1-826e-b60a8e339b05 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:39.247701 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a0fc096e-0d2a-47b1-826e-b60a8e339b05 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:39.248399 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a0fc096e-0d2a-47b1-826e-b60a8e339b05 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:39.249115 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a0fc096e-0d2a-47b1-826e-b60a8e339b05 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:39.249541 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a0fc096e-0d2a-47b1-826e-b60a8e339b05 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:39.279299 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a0fc096e-0d2a-47b1-826e-b60a8e339b05 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045587 Sep 18 00:59:39.279866 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 234/467] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 00:59:39 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 00:59:39.343199 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-47258eaf-315d-4f66-8eb9-876d507cc6a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:39.343709 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-47258eaf-315d-4f66-8eb9-876d507cc6a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:39.350068 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-47258eaf-315d-4f66-8eb9-876d507cc6a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:39.350547 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-47258eaf-315d-4f66-8eb9-876d507cc6a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:39.351008 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-47258eaf-315d-4f66-8eb9-876d507cc6a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:39.351688 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-47258eaf-315d-4f66-8eb9-876d507cc6a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:39.352136 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-47258eaf-315d-4f66-8eb9-876d507cc6a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:39.352591 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-47258eaf-315d-4f66-8eb9-876d507cc6a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:39.382542 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-47258eaf-315d-4f66-8eb9-876d507cc6a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Going to try to terminate instance {{(pid=120687) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 00:59:39.468600 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-47258eaf-315d-4f66-8eb9-876d507cc6a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 204 len: 0 microversion: 2.1 time: 0.128764 Sep 18 00:59:39.469203 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 234/468] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 00:59:39 2022] DELETE /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 00:59:39.477471 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3e8cb1ca-d7ae-48f5-8929-fac6585320f6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:39.478089 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3e8cb1ca-d7ae-48f5-8929-fac6585320f6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:39.484056 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3e8cb1ca-d7ae-48f5-8929-fac6585320f6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:39.484544 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3e8cb1ca-d7ae-48f5-8929-fac6585320f6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:39.484980 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3e8cb1ca-d7ae-48f5-8929-fac6585320f6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:39.485673 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3e8cb1ca-d7ae-48f5-8929-fac6585320f6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:39.486134 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3e8cb1ca-d7ae-48f5-8929-fac6585320f6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:39.486560 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3e8cb1ca-d7ae-48f5-8929-fac6585320f6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:39.628166 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3e8cb1ca-d7ae-48f5-8929-fac6585320f6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:39.637373 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3e8cb1ca-d7ae-48f5-8929-fac6585320f6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1679 microversion: 2.1 time: 0.163796 Sep 18 00:59:39.637944 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 235/469] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:39 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:40.315234 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-16d84e81-8f1a-4eef-98a3-6a02c3afd431 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:40.315849 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-16d84e81-8f1a-4eef-98a3-6a02c3afd431 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:40.321789 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16d84e81-8f1a-4eef-98a3-6a02c3afd431 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:40.322305 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16d84e81-8f1a-4eef-98a3-6a02c3afd431 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:40.322741 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16d84e81-8f1a-4eef-98a3-6a02c3afd431 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:40.323501 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16d84e81-8f1a-4eef-98a3-6a02c3afd431 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:40.323987 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16d84e81-8f1a-4eef-98a3-6a02c3afd431 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:40.324426 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16d84e81-8f1a-4eef-98a3-6a02c3afd431 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:40.410683 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-16d84e81-8f1a-4eef-98a3-6a02c3afd431 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lazy-loading 'services' on Instance uuid 234a399b-97be-4b3b-8bdb-75278ffdc4e0 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:59:40.481902 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-16d84e81-8f1a-4eef-98a3-6a02c3afd431 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "DELETE /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0/os-volume_attachments/c9550c04-883f-401e-8fa4-f8dc0dfc74f9" status: 202 len: 0 microversion: 2.1 time: 0.170933 Sep 18 00:59:40.482538 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 235/470] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 00:59:40 2022] DELETE /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0/os-volume_attachments/c9550c04-883f-401e-8fa4-f8dc0dfc74f9 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 00:59:40.664038 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1337bbaf-1f18-41ea-8891-0e4a4c1d38b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:40.664655 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-1337bbaf-1f18-41ea-8891-0e4a4c1d38b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:40.671186 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1337bbaf-1f18-41ea-8891-0e4a4c1d38b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:40.671674 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1337bbaf-1f18-41ea-8891-0e4a4c1d38b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:40.672110 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1337bbaf-1f18-41ea-8891-0e4a4c1d38b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:40.672815 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1337bbaf-1f18-41ea-8891-0e4a4c1d38b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:40.673267 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1337bbaf-1f18-41ea-8891-0e4a4c1d38b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:40.673692 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1337bbaf-1f18-41ea-8891-0e4a4c1d38b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:40.803444 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-1337bbaf-1f18-41ea-8891-0e4a4c1d38b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:40.811320 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-1337bbaf-1f18-41ea-8891-0e4a4c1d38b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1679 microversion: 2.1 time: 0.151221 Sep 18 00:59:40.811893 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 236/471] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:40 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:41.838015 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3ac0e930-7e39-449d-bc87-73859296706f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:41.838713 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3ac0e930-7e39-449d-bc87-73859296706f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:41.844854 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3ac0e930-7e39-449d-bc87-73859296706f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:41.845335 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3ac0e930-7e39-449d-bc87-73859296706f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:41.845771 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3ac0e930-7e39-449d-bc87-73859296706f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:41.846457 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3ac0e930-7e39-449d-bc87-73859296706f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:41.846938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3ac0e930-7e39-449d-bc87-73859296706f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:41.847365 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3ac0e930-7e39-449d-bc87-73859296706f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:42.017659 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3ac0e930-7e39-449d-bc87-73859296706f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:42.025499 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3ac0e930-7e39-449d-bc87-73859296706f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1679 microversion: 2.1 time: 0.192829 Sep 18 00:59:42.026065 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 236/472] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:41 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:42.548096 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c60c377c-5ef3-44b0-be26-adaea8ce6d60 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "513ece0f-895c-4c87-b700-09bc943f03f0"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:42.550696 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c60c377c-5ef3-44b0-be26-adaea8ce6d60 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:42.557574 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c60c377c-5ef3-44b0-be26-adaea8ce6d60 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:42.558146 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c60c377c-5ef3-44b0-be26-adaea8ce6d60 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:42.558658 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c60c377c-5ef3-44b0-be26-adaea8ce6d60 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:42.559458 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c60c377c-5ef3-44b0-be26-adaea8ce6d60 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:42.559919 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c60c377c-5ef3-44b0-be26-adaea8ce6d60 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:42.560347 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c60c377c-5ef3-44b0-be26-adaea8ce6d60 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:42.694378 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-aa11b331-6400-48da-b1d1-8772c5537b19 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:42.694939 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-aa11b331-6400-48da-b1d1-8772c5537b19 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:42.701785 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aa11b331-6400-48da-b1d1-8772c5537b19 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:42.702334 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aa11b331-6400-48da-b1d1-8772c5537b19 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:42.702770 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aa11b331-6400-48da-b1d1-8772c5537b19 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:42.703498 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aa11b331-6400-48da-b1d1-8772c5537b19 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:42.703959 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aa11b331-6400-48da-b1d1-8772c5537b19 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:42.704385 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aa11b331-6400-48da-b1d1-8772c5537b19 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:42.731961 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-aa11b331-6400-48da-b1d1-8772c5537b19 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Going to try to terminate instance {{(pid=120687) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 00:59:42.823198 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-aa11b331-6400-48da-b1d1-8772c5537b19 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "DELETE /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 204 len: 0 microversion: 2.1 time: 0.137380 Sep 18 00:59:42.824012 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 237/473] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 00:59:42 2022] DELETE /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 00:59:42.833199 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d42193ab-01f7-4476-a1eb-f3f9f6a77934 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:42.833903 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d42193ab-01f7-4476-a1eb-f3f9f6a77934 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:42.840881 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d42193ab-01f7-4476-a1eb-f3f9f6a77934 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:42.841553 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d42193ab-01f7-4476-a1eb-f3f9f6a77934 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:42.841930 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d42193ab-01f7-4476-a1eb-f3f9f6a77934 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:42.842644 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d42193ab-01f7-4476-a1eb-f3f9f6a77934 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:42.843144 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d42193ab-01f7-4476-a1eb-f3f9f6a77934 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:42.843578 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d42193ab-01f7-4476-a1eb-f3f9f6a77934 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:42.880813 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c60c377c-5ef3-44b0-be26-adaea8ce6d60 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "POST /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336542 Sep 18 00:59:42.881477 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 237/474] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 00:59:42 2022] POST /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:43.050436 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2544742c-da8e-4132-b1c2-b95d3aae4625 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:43.051604 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-2544742c-da8e-4132-b1c2-b95d3aae4625 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:43.061255 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2544742c-da8e-4132-b1c2-b95d3aae4625 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:43.062184 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2544742c-da8e-4132-b1c2-b95d3aae4625 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:43.062907 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2544742c-da8e-4132-b1c2-b95d3aae4625 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:43.063859 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2544742c-da8e-4132-b1c2-b95d3aae4625 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:43.064902 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2544742c-da8e-4132-b1c2-b95d3aae4625 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:43.065561 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2544742c-da8e-4132-b1c2-b95d3aae4625 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:43.090477 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d42193ab-01f7-4476-a1eb-f3f9f6a77934 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:43.092864 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:43.107529 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d42193ab-01f7-4476-a1eb-f3f9f6a77934 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1513 microversion: 2.1 time: 0.278862 Sep 18 00:59:43.111229 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 238/475] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:42 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:43.116296 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-734e605a-1185-4102-9028-c4defc43b071 req-48e062f4-efe9-45a7-9c4b-643f5b06a914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2055882-050f-4acf-a99c-96d698e25963", "name": "network-vif-deleted", "tag": "ff818f99-6875-42e7-8af0-6e7c1e9ef011"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:43.131776 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-734e605a-1185-4102-9028-c4defc43b071 req-48e062f4-efe9-45a7-9c4b-643f5b06a914 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:43.132532 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-734e605a-1185-4102-9028-c4defc43b071 req-48e062f4-efe9-45a7-9c4b-643f5b06a914 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:43.133125 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-734e605a-1185-4102-9028-c4defc43b071 req-48e062f4-efe9-45a7-9c4b-643f5b06a914 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:43.153423 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-734e605a-1185-4102-9028-c4defc43b071 req-48e062f4-efe9-45a7-9c4b-643f5b06a914 service nova] Creating event network-vif-deleted:ff818f99-6875-42e7-8af0-6e7c1e9ef011 for instance e2055882-050f-4acf-a99c-96d698e25963 on hv-cinder-maste Sep 18 00:59:43.155917 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2544742c-da8e-4132-b1c2-b95d3aae4625 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:43.159452 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-734e605a-1185-4102-9028-c4defc43b071 req-48e062f4-efe9-45a7-9c4b-643f5b06a914 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046787 Sep 18 00:59:43.160774 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 239/476] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:43.168984 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2544742c-da8e-4132-b1c2-b95d3aae4625 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1612 microversion: 2.1 time: 0.122541 Sep 18 00:59:43.169688 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 238/477] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:43 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1612 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:44.132195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4ab86468-e629-4b0f-b652-8a740758b882 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:44.132886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4ab86468-e629-4b0f-b652-8a740758b882 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:44.139660 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab86468-e629-4b0f-b652-8a740758b882 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:44.140086 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab86468-e629-4b0f-b652-8a740758b882 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:44.140519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab86468-e629-4b0f-b652-8a740758b882 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:44.141201 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab86468-e629-4b0f-b652-8a740758b882 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:44.141651 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab86468-e629-4b0f-b652-8a740758b882 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:44.142068 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4ab86468-e629-4b0f-b652-8a740758b882 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:44.192451 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-43d9e34b-8cdd-4cb2-be4e-8daab2d83c13 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:44.193182 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-43d9e34b-8cdd-4cb2-be4e-8daab2d83c13 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:44.200599 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43d9e34b-8cdd-4cb2-be4e-8daab2d83c13 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:44.201193 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43d9e34b-8cdd-4cb2-be4e-8daab2d83c13 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:44.201720 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43d9e34b-8cdd-4cb2-be4e-8daab2d83c13 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:44.202490 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43d9e34b-8cdd-4cb2-be4e-8daab2d83c13 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:44.203054 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43d9e34b-8cdd-4cb2-be4e-8daab2d83c13 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:44.203764 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-43d9e34b-8cdd-4cb2-be4e-8daab2d83c13 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:44.283725 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-43d9e34b-8cdd-4cb2-be4e-8daab2d83c13 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:44.291639 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-43d9e34b-8cdd-4cb2-be4e-8daab2d83c13 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1612 microversion: 2.1 time: 0.103014 Sep 18 00:59:44.292435 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 239/478] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:44 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1612 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:44.299848 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4ab86468-e629-4b0f-b652-8a740758b882 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:44.307858 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4ab86468-e629-4b0f-b652-8a740758b882 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1513 microversion: 2.1 time: 0.179792 Sep 18 00:59:44.308421 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 240/479] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:44 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:45.317871 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-510e313e-06cd-4b14-b668-e382a1a672cc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:45.318483 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-510e313e-06cd-4b14-b668-e382a1a672cc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:45.325648 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-510e313e-06cd-4b14-b668-e382a1a672cc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:45.326136 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-510e313e-06cd-4b14-b668-e382a1a672cc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:45.326574 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-510e313e-06cd-4b14-b668-e382a1a672cc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:45.327292 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-510e313e-06cd-4b14-b668-e382a1a672cc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:45.327755 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-510e313e-06cd-4b14-b668-e382a1a672cc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:45.328182 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-510e313e-06cd-4b14-b668-e382a1a672cc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:45.331455 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-90325108-2ea4-4efb-82ae-ad9cedaaae76 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:45.332078 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-90325108-2ea4-4efb-82ae-ad9cedaaae76 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:45.338560 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90325108-2ea4-4efb-82ae-ad9cedaaae76 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:45.339133 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90325108-2ea4-4efb-82ae-ad9cedaaae76 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:45.339573 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90325108-2ea4-4efb-82ae-ad9cedaaae76 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:45.340282 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90325108-2ea4-4efb-82ae-ad9cedaaae76 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:45.340746 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90325108-2ea4-4efb-82ae-ad9cedaaae76 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:45.341171 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90325108-2ea4-4efb-82ae-ad9cedaaae76 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:45.404221 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-510e313e-06cd-4b14-b668-e382a1a672cc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:45.412043 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-510e313e-06cd-4b14-b668-e382a1a672cc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1612 microversion: 2.1 time: 0.098015 Sep 18 00:59:45.412624 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 240/480] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:45 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1612 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:45.488588 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-90325108-2ea4-4efb-82ae-ad9cedaaae76 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:45.496702 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-90325108-2ea4-4efb-82ae-ad9cedaaae76 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1513 microversion: 2.1 time: 0.169070 Sep 18 00:59:45.497270 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 241/481] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:45 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:46.436464 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2ef36aba-2cb6-4f77-a9ef-0e488fb02055 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:46.437072 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-2ef36aba-2cb6-4f77-a9ef-0e488fb02055 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:46.439561 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=8 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:46.445354 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ef36aba-2cb6-4f77-a9ef-0e488fb02055 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:46.446341 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ef36aba-2cb6-4f77-a9ef-0e488fb02055 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:46.446775 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ef36aba-2cb6-4f77-a9ef-0e488fb02055 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:46.447501 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ef36aba-2cb6-4f77-a9ef-0e488fb02055 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:46.447985 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ef36aba-2cb6-4f77-a9ef-0e488fb02055 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:46.448408 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2ef36aba-2cb6-4f77-a9ef-0e488fb02055 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:46.510033 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2ef36aba-2cb6-4f77-a9ef-0e488fb02055 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:46.517769 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2ef36aba-2cb6-4f77-a9ef-0e488fb02055 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1612 microversion: 2.1 time: 0.085160 Sep 18 00:59:46.518342 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 241/482] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:46 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1612 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:46.520428 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-feac47a6-bdf7-41aa-a9ce-f78889c411d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:46.520986 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-feac47a6-bdf7-41aa-a9ce-f78889c411d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:46.527979 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feac47a6-bdf7-41aa-a9ce-f78889c411d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:46.528460 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feac47a6-bdf7-41aa-a9ce-f78889c411d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:46.528891 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feac47a6-bdf7-41aa-a9ce-f78889c411d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:46.529576 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feac47a6-bdf7-41aa-a9ce-f78889c411d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:46.530027 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feac47a6-bdf7-41aa-a9ce-f78889c411d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:46.530464 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feac47a6-bdf7-41aa-a9ce-f78889c411d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:46.670184 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-feac47a6-bdf7-41aa-a9ce-f78889c411d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:46.677926 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-feac47a6-bdf7-41aa-a9ce-f78889c411d5 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1513 microversion: 2.1 time: 0.161489 Sep 18 00:59:46.678500 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 242/483] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:46 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:47.542427 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b4216469-aa84-4b2e-99c3-d78cf1dbc688 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:47.542985 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b4216469-aa84-4b2e-99c3-d78cf1dbc688 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:47.549335 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b4216469-aa84-4b2e-99c3-d78cf1dbc688 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:47.549812 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b4216469-aa84-4b2e-99c3-d78cf1dbc688 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:47.550241 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b4216469-aa84-4b2e-99c3-d78cf1dbc688 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:47.550957 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b4216469-aa84-4b2e-99c3-d78cf1dbc688 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:47.551405 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b4216469-aa84-4b2e-99c3-d78cf1dbc688 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:47.551821 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b4216469-aa84-4b2e-99c3-d78cf1dbc688 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:47.612908 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-b4216469-aa84-4b2e-99c3-d78cf1dbc688 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:47.621552 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b4216469-aa84-4b2e-99c3-d78cf1dbc688 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1612 microversion: 2.1 time: 0.084069 Sep 18 00:59:47.622108 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 242/484] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:47 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1612 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:47.701590 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-628ff108-f156-4b9e-96a4-a7fe3e108689 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:47.702210 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-628ff108-f156-4b9e-96a4-a7fe3e108689 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:47.708430 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628ff108-f156-4b9e-96a4-a7fe3e108689 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:47.708921 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628ff108-f156-4b9e-96a4-a7fe3e108689 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:47.709359 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628ff108-f156-4b9e-96a4-a7fe3e108689 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:47.710057 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628ff108-f156-4b9e-96a4-a7fe3e108689 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:47.710520 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628ff108-f156-4b9e-96a4-a7fe3e108689 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:47.711499 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628ff108-f156-4b9e-96a4-a7fe3e108689 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:47.838538 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-628ff108-f156-4b9e-96a4-a7fe3e108689 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:47.846295 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-628ff108-f156-4b9e-96a4-a7fe3e108689 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1513 microversion: 2.1 time: 0.148674 Sep 18 00:59:47.846970 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 243/485] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:47 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:48.645480 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:48.646674 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:48.654379 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:48.654882 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:48.655385 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:48.656416 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:48.656870 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:48.657476 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:48.697429 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:48.697925 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:48.698364 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:48.698832 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lazy-loading 'fault' on Instance uuid e2055882-050f-4acf-a99c-96d698e25963 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:59:48.769577 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:48.778845 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-35602d1d-7659-402f-aa6f-ec2c10cc07a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1330 microversion: 2.1 time: 0.137295 Sep 18 00:59:48.779414 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 243/486] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:48 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1330 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:48.870046 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-68134617-0763-46a1-bacc-c18535cfe5c1 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:48.870759 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-68134617-0763-46a1-bacc-c18535cfe5c1 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:48.877618 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68134617-0763-46a1-bacc-c18535cfe5c1 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:48.878111 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68134617-0763-46a1-bacc-c18535cfe5c1 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:48.878548 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68134617-0763-46a1-bacc-c18535cfe5c1 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:48.879279 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68134617-0763-46a1-bacc-c18535cfe5c1 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:48.879739 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68134617-0763-46a1-bacc-c18535cfe5c1 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:48.880168 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68134617-0763-46a1-bacc-c18535cfe5c1 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:49.108164 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-da722862-128e-49ed-a60d-1a3c9c01e2ca req-0050ebb8-4777-4976-9663-793f6e379a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "234a399b-97be-4b3b-8bdb-75278ffdc4e0", "name": "network-vif-deleted", "tag": "41adca23-a8d9-445c-9eaa-f1623bb2425c"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:49.109761 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-68134617-0763-46a1-bacc-c18535cfe5c1 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:49.117824 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-da722862-128e-49ed-a60d-1a3c9c01e2ca req-0050ebb8-4777-4976-9663-793f6e379a11 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:49.118260 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-68134617-0763-46a1-bacc-c18535cfe5c1 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1513 microversion: 2.1 time: 0.252439 Sep 18 00:59:49.118383 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-da722862-128e-49ed-a60d-1a3c9c01e2ca req-0050ebb8-4777-4976-9663-793f6e379a11 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:49.118716 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-da722862-128e-49ed-a60d-1a3c9c01e2ca req-0050ebb8-4777-4976-9663-793f6e379a11 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:49.119022 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 244/487] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:48 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:49.130147 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-da722862-128e-49ed-a60d-1a3c9c01e2ca req-0050ebb8-4777-4976-9663-793f6e379a11 service nova] Creating event network-vif-deleted:41adca23-a8d9-445c-9eaa-f1623bb2425c for instance 234a399b-97be-4b3b-8bdb-75278ffdc4e0 on hv-cinder-maste Sep 18 00:59:49.135845 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-da722862-128e-49ed-a60d-1a3c9c01e2ca req-0050ebb8-4777-4976-9663-793f6e379a11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032372 Sep 18 00:59:49.136428 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 244/488] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 00:59:49.802326 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:49.802976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:49.810322 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:49.810824 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:49.811298 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:49.812118 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:49.812674 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:49.813389 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:49.850441 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:49.850968 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:49.851487 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:49.852158 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lazy-loading 'fault' on Instance uuid e2055882-050f-4acf-a99c-96d698e25963 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:59:49.892942 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:49.899942 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-04ca93fb-88fb-45b3-af46-b41f7b1318b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 200 len: 1330 microversion: 2.1 time: 0.102030 Sep 18 00:59:49.900512 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 245/489] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:49 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:50.142494 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:50.143219 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:50.150218 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:50.150708 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:50.151175 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:50.151880 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:50.152339 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:50.152761 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:50.185837 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:50.186325 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:50.186762 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:50.187325 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lazy-loading 'fault' on Instance uuid 234a399b-97be-4b3b-8bdb-75278ffdc4e0 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:59:50.237320 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:50.242836 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:50.249193 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3808c187-c7d5-4dc8-b69a-858717961eb7 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 200 len: 1308 microversion: 2.1 time: 0.110839 Sep 18 00:59:50.249782 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 245/490] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:50 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:50.453847 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f52e509c-f2a9-4016-b878-92000d7a58ac tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:50.456033 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f52e509c-f2a9-4016-b878-92000d7a58ac tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:50.462776 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f52e509c-f2a9-4016-b878-92000d7a58ac tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:50.463285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f52e509c-f2a9-4016-b878-92000d7a58ac tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:50.463719 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f52e509c-f2a9-4016-b878-92000d7a58ac tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:50.464413 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f52e509c-f2a9-4016-b878-92000d7a58ac tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:50.464925 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f52e509c-f2a9-4016-b878-92000d7a58ac tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:50.465348 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f52e509c-f2a9-4016-b878-92000d7a58ac tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:50.489325 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-f52e509c-f2a9-4016-b878-92000d7a58ac tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lazy-loading 'flavor' on Instance uuid ecc591cc-e74d-48ea-85e8-945b2995d123 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 00:59:50.610818 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f52e509c-f2a9-4016-b878-92000d7a58ac tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "POST /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/action" status: 200 len: 32 microversion: 2.1 time: 0.160805 Sep 18 00:59:50.615811 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 246/491] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 00:59:50 2022] POST /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 00:59:50.629886 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-eefc5aeb-3e8d-46e3-a2a4-16de836183f3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:50.630494 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-eefc5aeb-3e8d-46e3-a2a4-16de836183f3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:50.637752 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eefc5aeb-3e8d-46e3-a2a4-16de836183f3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:50.638239 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eefc5aeb-3e8d-46e3-a2a4-16de836183f3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:50.638675 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eefc5aeb-3e8d-46e3-a2a4-16de836183f3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:50.639386 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eefc5aeb-3e8d-46e3-a2a4-16de836183f3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:50.639841 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eefc5aeb-3e8d-46e3-a2a4-16de836183f3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:50.640261 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eefc5aeb-3e8d-46e3-a2a4-16de836183f3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:50.767307 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-eefc5aeb-3e8d-46e3-a2a4-16de836183f3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:50.777115 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-eefc5aeb-3e8d-46e3-a2a4-16de836183f3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.151523 Sep 18 00:59:50.777704 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 246/492] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:50 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:50.923893 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:50.924593 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:50.931511 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:50.932006 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:50.932439 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:50.933144 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:50.933598 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:50.934210 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:50.950478 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 HTTP/1.1 Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 00:59:50.952797 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 00:59:50.954363 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': 'e2055882-050f-4acf-a99c-96d698e25963'} Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:59:50.955272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 00:59:50.956700 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:50.957983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:59:50.957983 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a142a45e-03e7-4ebe-8141-2075997fc47a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 404 len: 111 microversion: 2.1 time: 0.037476 Sep 18 00:59:50.958511 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 247/493] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:50 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 00:59:50.968409 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d42534c0-1890-4b16-8cc1-dd18aa747ff6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '.version_select at 0x7f5672a7c4c0>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:50.991669 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d42534c0-1890-4b16-8cc1-dd18aa747ff6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-25974457" status: 202 len: 0 microversion: 2.1 time: 0.027641 Sep 18 00:59:50.992511 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 247/494] 10.222.0.33 () {58 vars in 1215 bytes} [Sun Sep 18 00:59:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-25974457 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 00:59:51.274285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:51.274837 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: 234a399b-97be-4b3b-8bdb-75278ffdc4e0] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:51.280825 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:51.281334 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:51.281837 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:51.282542 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:51.283442 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:51.283555 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:51.298270 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] HTTP exception thrown: Instance 234a399b-97be-4b3b-8bdb-75278ffdc4e0 could not be found. Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Request method failure captured: Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 HTTP/1.1 Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJm0nf-3wPnDccIqgqPwkBEpX8SyUu6hRxMKNSU_2bZ_J4hJVSMnQET7iyQy3TQBk3c-Dpbt6fJlCrYQDYJ9VhLWjZr2p22zFarziY8ZK2HgB_cAPG_r-eJFNMuhrY6tciBIsNqpHEm4fYEsxMmjc8-4pF-AkK9smyy1_f-F9NfyoWMI Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: a5eba1f622574f5cacecaccdba833801 Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-VolumesSnapshotTestJSON-698728750 Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 00:59:51.299827 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a5eba1f622574f5cacecaccdba833801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a5eba1f622574f5cacecaccdba833801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a5eba1f622574f5cacecaccdba833801", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a5eba1f622574f5cacecaccdba833801"}]}] Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-VolumesSnapshotTestJSON-698728750 Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: a5eba1f622574f5cacecaccdba833801 Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-698728750 Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-VolumesSnapshotTestJSON-698728750-project Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: d23f9e763a994566bddd9508a79cce54 Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-VolumesSnapshotTestJSON-698728750-project Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance 234a399b-97be-4b3b-8bdb-75278ffdc4e0 could not be found. Sep 18 00:59:51.301362 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '234a399b-97be-4b3b-8bdb-75278ffdc4e0'} Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 234a399b-97be-4b3b-8bdb-75278ffdc4e0 could not be found. Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 00:59:51.302408 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234a399b-97be-4b3b-8bdb-75278ffdc4e0 could not be found. Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234a399b-97be-4b3b-8bdb-75278ffdc4e0 could not be found. Sep 18 00:59:51.303923 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 00:59:51.305235 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Returning 404 to user: Instance 234a399b-97be-4b3b-8bdb-75278ffdc4e0 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 00:59:51.305235 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-aaf64ee1-43ef-45b0-b490-c7bd8ad634fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0" status: 404 len: 111 microversion: 2.1 time: 0.031635 Sep 18 00:59:51.305235 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 248/495] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:51 2022] GET /compute/v2.1/servers/234a399b-97be-4b3b-8bdb-75278ffdc4e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 00:59:51.801376 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-33f99659-8ceb-4764-b0fd-e340a052ee61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:51.801909 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-33f99659-8ceb-4764-b0fd-e340a052ee61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:51.809990 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33f99659-8ceb-4764-b0fd-e340a052ee61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:51.810483 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33f99659-8ceb-4764-b0fd-e340a052ee61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:51.810961 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33f99659-8ceb-4764-b0fd-e340a052ee61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:51.811674 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33f99659-8ceb-4764-b0fd-e340a052ee61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:51.812136 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33f99659-8ceb-4764-b0fd-e340a052ee61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:51.812561 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-33f99659-8ceb-4764-b0fd-e340a052ee61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:52.006918 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-33f99659-8ceb-4764-b0fd-e340a052ee61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:52.016546 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-33f99659-8ceb-4764-b0fd-e340a052ee61 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.219253 Sep 18 00:59:52.017129 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 248/496] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:51 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:52.129389 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-6c983d61-3949-4789-adb8-a38a7e10d65a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: .version_select at 0x7f5672c40c10>, body: {"keypair": {"name": "tempest-keypair-1769906644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF17E2MBp0psaJrnhi/jDZEYPcrX8niftFgGtJONecUuStX3rf5hWcQTrheZksd1pkI4v1DKzd9wejC+Ke5Zx4CZRm9SVG0L/diwqHfpUOO4UQ/F0XZ53oDdQ6roL5+vVA=="}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:52.145957 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-6c983d61-3949-4789-adb8-a38a7e10d65a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:59:52.150365 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-6c983d61-3949-4789-adb8-a38a7e10d65a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for user f19ac9f3986640ae9b7993b98dd403c0 and project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:59:52.173172 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-6c983d61-3949-4789-adb8-a38a7e10d65a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047580 Sep 18 00:59:52.173841 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 249/497] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 18 00:59:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:53.040771 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b344a93e-4eb5-4b40-a922-17c34da0abad tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:53.041415 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b344a93e-4eb5-4b40-a922-17c34da0abad tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:53.047577 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b344a93e-4eb5-4b40-a922-17c34da0abad tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:53.048057 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b344a93e-4eb5-4b40-a922-17c34da0abad tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:53.048494 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b344a93e-4eb5-4b40-a922-17c34da0abad tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:53.049185 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b344a93e-4eb5-4b40-a922-17c34da0abad tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:53.049635 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b344a93e-4eb5-4b40-a922-17c34da0abad tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:53.050051 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b344a93e-4eb5-4b40-a922-17c34da0abad tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:53.185212 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-b344a93e-4eb5-4b40-a922-17c34da0abad tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:53.193409 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b344a93e-4eb5-4b40-a922-17c34da0abad tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.156860 Sep 18 00:59:53.194125 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 249/498] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:53 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:53.461689 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1899866630", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eee7c814-dc91-4de0-b55e-0732fcd7c9de"}], "security_groups": [{"name": "tempest-securitygroup--473890881"}], "key_name": "tempest-keypair-1769906644", "user_data": "}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:53.567486 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] validate_networks() for [('eee7c814-dc91-4de0-b55e-0732fcd7c9de', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:59:53.953381 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:59:53.953785 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:59:53.954255 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:59:53.954661 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:59:53.955191 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:59:53.965057 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:53.965541 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:53.965976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:53.971917 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:53.971917 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:53.971917 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:53.988234 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:59:53.990399 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:53.995293 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for user f19ac9f3986640ae9b7993b98dd403c0 and project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:59:54.011815 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:59:54.014193 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:59:54.061362 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e8a95164-9248-4d4a-bc30-3bd0c611a557 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.604598 Sep 18 00:59:54.061986 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 250/499] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:59:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:59:54.077507 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-dd9f2990-97df-4f51-92de-3cea4ea8aa76 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:54.078369 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-dd9f2990-97df-4f51-92de-3cea4ea8aa76 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:54.135235 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-dd9f2990-97df-4f51-92de-3cea4ea8aa76 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:54.142239 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-dd9f2990-97df-4f51-92de-3cea4ea8aa76 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1242 microversion: 2.1 time: 0.068716 Sep 18 00:59:54.143093 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 250/500] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:54 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:54.218716 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-41b5b06d-8f62-4e53-b678-e8c7c5947aab tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:54.219345 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-41b5b06d-8f62-4e53-b678-e8c7c5947aab tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:54.225652 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-41b5b06d-8f62-4e53-b678-e8c7c5947aab tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:54.226682 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-41b5b06d-8f62-4e53-b678-e8c7c5947aab tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:54.227185 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-41b5b06d-8f62-4e53-b678-e8c7c5947aab tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:54.227892 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-41b5b06d-8f62-4e53-b678-e8c7c5947aab tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:54.228351 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-41b5b06d-8f62-4e53-b678-e8c7c5947aab tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:54.228780 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-41b5b06d-8f62-4e53-b678-e8c7c5947aab tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:54.373434 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-41b5b06d-8f62-4e53-b678-e8c7c5947aab tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:54.381877 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-41b5b06d-8f62-4e53-b678-e8c7c5947aab tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.167048 Sep 18 00:59:54.383680 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 251/501] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:54 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:55.058312 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1430084470", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "networks": [{"uuid": "fd165d05-651e-4c2d-9094-a51f056f104b"}]}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:55.110340 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.network.neutron [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] validate_networks() for [('fd165d05-651e-4c2d-9094-a51f056f104b', None, None, None, None, None)] {{(pid=120686) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 00:59:55.165454 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-77a9613b-195d-4e3a-bb37-ba3c54088b00 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:55.166098 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-77a9613b-195d-4e3a-bb37-ba3c54088b00 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:55.172519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-77a9613b-195d-4e3a-bb37-ba3c54088b00 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:55.173034 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-77a9613b-195d-4e3a-bb37-ba3c54088b00 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:55.173471 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-77a9613b-195d-4e3a-bb37-ba3c54088b00 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:55.174161 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-77a9613b-195d-4e3a-bb37-ba3c54088b00 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:55.174627 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-77a9613b-195d-4e3a-bb37-ba3c54088b00 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:55.175069 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-77a9613b-195d-4e3a-bb37-ba3c54088b00 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:55.256650 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-77a9613b-195d-4e3a-bb37-ba3c54088b00 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:55.265157 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-77a9613b-195d-4e3a-bb37-ba3c54088b00 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1294 microversion: 2.1 time: 0.103562 Sep 18 00:59:55.265729 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 252/502] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:55 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:55.406440 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a5d1919c-00a0-4abb-98af-01efed65fae1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:55.407106 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a5d1919c-00a0-4abb-98af-01efed65fae1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:55.413971 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a5d1919c-00a0-4abb-98af-01efed65fae1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:55.414711 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a5d1919c-00a0-4abb-98af-01efed65fae1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:55.415336 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a5d1919c-00a0-4abb-98af-01efed65fae1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:55.416199 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a5d1919c-00a0-4abb-98af-01efed65fae1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:55.416814 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a5d1919c-00a0-4abb-98af-01efed65fae1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:55.417397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a5d1919c-00a0-4abb-98af-01efed65fae1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:55.643595 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Flavor limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 00:59:55.644046 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Image limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 00:59:55.644552 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Flavor pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 00:59:55.644998 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Image pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 00:59:55.645413 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 00:59:55.654533 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:55.655060 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:55.655500 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:55.656231 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:55.656691 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:55.657119 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:55.675122 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Getting quotas for project a5eba1f622574f5cacecaccdba833801. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 00:59:55.679797 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Getting quotas for user d23f9e763a994566bddd9508a79cce54 and project a5eba1f622574f5cacecaccdba833801. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 00:59:55.680106 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a5d1919c-00a0-4abb-98af-01efed65fae1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:55.689715 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a5d1919c-00a0-4abb-98af-01efed65fae1 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.287258 Sep 18 00:59:55.690297 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 253/503] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:55 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:55.691494 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Going to run 1 instances... {{(pid=120686) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 00:59:55.693810 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 00:59:55.740496 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-62a9e6d9-fc4a-4bf8-8246-7875d857825e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686827 Sep 18 00:59:55.741444 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 251/504] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 00:59:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 00:59:55.752897 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-72349071-5247-4ce2-a769-503bd66caaff tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:55.753621 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-72349071-5247-4ce2-a769-503bd66caaff tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:55.826850 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-72349071-5247-4ce2-a769-503bd66caaff tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:55.834326 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-72349071-5247-4ce2-a769-503bd66caaff tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1219 microversion: 2.1 time: 0.085214 Sep 18 00:59:55.835069 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 254/505] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:55 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:56.289776 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e141ae6b-2155-4e0c-8737-736934bb0afe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:56.290385 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e141ae6b-2155-4e0c-8737-736934bb0afe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:56.296734 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e141ae6b-2155-4e0c-8737-736934bb0afe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:56.297237 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e141ae6b-2155-4e0c-8737-736934bb0afe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:56.297670 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e141ae6b-2155-4e0c-8737-736934bb0afe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:56.298378 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e141ae6b-2155-4e0c-8737-736934bb0afe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:56.298907 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e141ae6b-2155-4e0c-8737-736934bb0afe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:56.299338 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e141ae6b-2155-4e0c-8737-736934bb0afe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:56.514678 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e141ae6b-2155-4e0c-8737-736934bb0afe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:56.523997 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e141ae6b-2155-4e0c-8737-736934bb0afe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1367 microversion: 2.1 time: 0.239133 Sep 18 00:59:56.524573 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 252/506] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:56 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:56.714158 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-23db90b1-308e-49e5-af59-c41614b0d11c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:56.714803 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-23db90b1-308e-49e5-af59-c41614b0d11c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:56.721329 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-23db90b1-308e-49e5-af59-c41614b0d11c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:56.721826 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-23db90b1-308e-49e5-af59-c41614b0d11c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:56.722267 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-23db90b1-308e-49e5-af59-c41614b0d11c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:56.723001 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-23db90b1-308e-49e5-af59-c41614b0d11c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:56.723468 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-23db90b1-308e-49e5-af59-c41614b0d11c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:56.723900 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-23db90b1-308e-49e5-af59-c41614b0d11c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:56.857707 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-6225ecbc-bb06-4477-9e3f-656acaf92589 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:56.858316 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6225ecbc-bb06-4477-9e3f-656acaf92589 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:56.868744 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6225ecbc-bb06-4477-9e3f-656acaf92589 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:56.869229 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6225ecbc-bb06-4477-9e3f-656acaf92589 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:56.869880 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6225ecbc-bb06-4477-9e3f-656acaf92589 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:56.870591 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6225ecbc-bb06-4477-9e3f-656acaf92589 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:56.871078 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6225ecbc-bb06-4477-9e3f-656acaf92589 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:56.871709 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6225ecbc-bb06-4477-9e3f-656acaf92589 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:56.950983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-23db90b1-308e-49e5-af59-c41614b0d11c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:56.956525 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6225ecbc-bb06-4477-9e3f-656acaf92589 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:56.961243 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-23db90b1-308e-49e5-af59-c41614b0d11c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.251623 Sep 18 00:59:56.967462 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-6225ecbc-bb06-4477-9e3f-656acaf92589 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1271 microversion: 2.1 time: 0.114000 Sep 18 00:59:56.968698 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 253/507] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:56 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:56.984225 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 255/508] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:56 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:57.258290 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-2f1b3d20-5454-4398-82db-b79412de5067 req-83dbec79-16e6-482c-9e2e-afd88a5402bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27162b19-b4be-4478-8644-79f59ff58586", "tag": "676125cb-60fb-496b-b796-92d00340f299"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:57.277752 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-2f1b3d20-5454-4398-82db-b79412de5067 req-83dbec79-16e6-482c-9e2e-afd88a5402bd service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.281121 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-2f1b3d20-5454-4398-82db-b79412de5067 req-83dbec79-16e6-482c-9e2e-afd88a5402bd service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.281765 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-2f1b3d20-5454-4398-82db-b79412de5067 req-83dbec79-16e6-482c-9e2e-afd88a5402bd service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.301895 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-2f1b3d20-5454-4398-82db-b79412de5067 req-83dbec79-16e6-482c-9e2e-afd88a5402bd service nova] Creating event network-changed:676125cb-60fb-496b-b796-92d00340f299 for instance 27162b19-b4be-4478-8644-79f59ff58586 on hv-cinder-maste Sep 18 00:59:57.307667 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-2f1b3d20-5454-4398-82db-b79412de5067 req-83dbec79-16e6-482c-9e2e-afd88a5402bd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055406 Sep 18 00:59:57.308541 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 254/509] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:57.547859 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-69712ca6-4e55-4494-808a-f92058310069 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:57.548541 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-69712ca6-4e55-4494-808a-f92058310069 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:57.555090 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-69712ca6-4e55-4494-808a-f92058310069 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.555583 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-69712ca6-4e55-4494-808a-f92058310069 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.556027 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-69712ca6-4e55-4494-808a-f92058310069 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.556725 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-69712ca6-4e55-4494-808a-f92058310069 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:57.557185 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-69712ca6-4e55-4494-808a-f92058310069 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:57.557614 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-69712ca6-4e55-4494-808a-f92058310069 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:57.747301 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-69712ca6-4e55-4494-808a-f92058310069 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:57.755456 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-69712ca6-4e55-4494-808a-f92058310069 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1367 microversion: 2.1 time: 0.211433 Sep 18 00:59:57.767023 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 256/510] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:57 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:57.992025 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-88818bbd-b817-4aef-a4ab-09fb92fb2f40 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:57.992749 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-88818bbd-b817-4aef-a4ab-09fb92fb2f40 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:57.999419 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-88818bbd-b817-4aef-a4ab-09fb92fb2f40 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.000011 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-88818bbd-b817-4aef-a4ab-09fb92fb2f40 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.001784 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-88818bbd-b817-4aef-a4ab-09fb92fb2f40 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.001784 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-88818bbd-b817-4aef-a4ab-09fb92fb2f40 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.001784 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-88818bbd-b817-4aef-a4ab-09fb92fb2f40 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.002116 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-88818bbd-b817-4aef-a4ab-09fb92fb2f40 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.007715 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-352a0973-d5e8-4a7c-96b3-0f1bba2f25ff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:58.008576 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-352a0973-d5e8-4a7c-96b3-0f1bba2f25ff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:58.015372 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-352a0973-d5e8-4a7c-96b3-0f1bba2f25ff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.015860 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-352a0973-d5e8-4a7c-96b3-0f1bba2f25ff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.016474 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-352a0973-d5e8-4a7c-96b3-0f1bba2f25ff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.017426 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-352a0973-d5e8-4a7c-96b3-0f1bba2f25ff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.017832 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-352a0973-d5e8-4a7c-96b3-0f1bba2f25ff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.018261 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-352a0973-d5e8-4a7c-96b3-0f1bba2f25ff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.071281 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-88818bbd-b817-4aef-a4ab-09fb92fb2f40 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:58.081357 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-88818bbd-b817-4aef-a4ab-09fb92fb2f40 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1277 microversion: 2.1 time: 0.094080 Sep 18 00:59:58.082197 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 255/511] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:57 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:58.167782 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-352a0973-d5e8-4a7c-96b3-0f1bba2f25ff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:58.170043 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:58.177586 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-352a0973-d5e8-4a7c-96b3-0f1bba2f25ff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.174351 Sep 18 00:59:58.178161 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 257/512] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:58 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:58.779732 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d42fac17-8e5f-46af-a649-493917db9e7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:58.780330 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d42fac17-8e5f-46af-a649-493917db9e7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:58.786818 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d42fac17-8e5f-46af-a649-493917db9e7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.787313 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d42fac17-8e5f-46af-a649-493917db9e7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.787749 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d42fac17-8e5f-46af-a649-493917db9e7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.789106 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d42fac17-8e5f-46af-a649-493917db9e7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:58.789562 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d42fac17-8e5f-46af-a649-493917db9e7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:58.789989 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d42fac17-8e5f-46af-a649-493917db9e7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:58.922955 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d42fac17-8e5f-46af-a649-493917db9e7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:58.930539 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d42fac17-8e5f-46af-a649-493917db9e7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1367 microversion: 2.1 time: 0.154731 Sep 18 00:59:58.931133 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 256/513] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:58 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:59.105896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4f962584-b654-47bc-98d2-585ecb5d86a3 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:59.106763 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4f962584-b654-47bc-98d2-585ecb5d86a3 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:59.114366 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4f962584-b654-47bc-98d2-585ecb5d86a3 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.115198 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4f962584-b654-47bc-98d2-585ecb5d86a3 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.115388 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4f962584-b654-47bc-98d2-585ecb5d86a3 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.116046 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4f962584-b654-47bc-98d2-585ecb5d86a3 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.116510 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4f962584-b654-47bc-98d2-585ecb5d86a3 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.117207 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4f962584-b654-47bc-98d2-585ecb5d86a3 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.201417 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e80701f2-b42b-4c30-b158-b06956d403e7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:59.202036 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e80701f2-b42b-4c30-b158-b06956d403e7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:59.208316 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e80701f2-b42b-4c30-b158-b06956d403e7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.209007 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e80701f2-b42b-4c30-b158-b06956d403e7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.209605 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e80701f2-b42b-4c30-b158-b06956d403e7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.211241 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e80701f2-b42b-4c30-b158-b06956d403e7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.211955 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e80701f2-b42b-4c30-b158-b06956d403e7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.212568 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e80701f2-b42b-4c30-b158-b06956d403e7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.409437 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4f962584-b654-47bc-98d2-585ecb5d86a3 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:59.422710 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4f962584-b654-47bc-98d2-585ecb5d86a3 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1319 microversion: 2.1 time: 0.321504 Sep 18 00:59:59.423717 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 258/514] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:59 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 00:59:59.480402 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e80701f2-b42b-4c30-b158-b06956d403e7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 00:59:59.489397 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e80701f2-b42b-4c30-b158-b06956d403e7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.291771 Sep 18 00:59:59.490068 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 257/515] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:59 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 00:59:59.737650 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-6402cdfb-b891-4ec7-a945-56cfb15cf011 req-6b723f6f-c95a-4c70-ae34-4aec3f960d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def988da-b233-4deb-b329-656813dfed41", "tag": "1239cb20-24bd-4543-8342-b66e69ae21eb"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 00:59:59.747966 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-6402cdfb-b891-4ec7-a945-56cfb15cf011 req-6b723f6f-c95a-4c70-ae34-4aec3f960d0a service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.748730 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-6402cdfb-b891-4ec7-a945-56cfb15cf011 req-6b723f6f-c95a-4c70-ae34-4aec3f960d0a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.749332 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-6402cdfb-b891-4ec7-a945-56cfb15cf011 req-6b723f6f-c95a-4c70-ae34-4aec3f960d0a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.761286 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-6402cdfb-b891-4ec7-a945-56cfb15cf011 req-6b723f6f-c95a-4c70-ae34-4aec3f960d0a service nova] Creating event network-changed:1239cb20-24bd-4543-8342-b66e69ae21eb for instance def988da-b233-4deb-b329-656813dfed41 on hv-cinder-maste Sep 18 00:59:59.766137 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-6402cdfb-b891-4ec7-a945-56cfb15cf011 req-6b723f6f-c95a-4c70-ae34-4aec3f960d0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032077 Sep 18 00:59:59.767133 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 259/516] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 00:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 00:59:59.953504 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-bd8efbc5-0ad1-4ed2-96cd-80dbdce8fd61 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 00:59:59.954108 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-bd8efbc5-0ad1-4ed2-96cd-80dbdce8fd61 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 00:59:59.961400 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd8efbc5-0ad1-4ed2-96cd-80dbdce8fd61 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.961904 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd8efbc5-0ad1-4ed2-96cd-80dbdce8fd61 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.962347 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd8efbc5-0ad1-4ed2-96cd-80dbdce8fd61 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 00:59:59.963083 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd8efbc5-0ad1-4ed2-96cd-80dbdce8fd61 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 00:59:59.963801 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd8efbc5-0ad1-4ed2-96cd-80dbdce8fd61 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 00:59:59.964090 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bd8efbc5-0ad1-4ed2-96cd-80dbdce8fd61 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:00.412360 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-bd8efbc5-0ad1-4ed2-96cd-80dbdce8fd61 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:00.420131 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-bd8efbc5-0ad1-4ed2-96cd-80dbdce8fd61 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1367 microversion: 2.1 time: 0.470476 Sep 18 01:00:00.420710 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 258/517] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 00:59:59 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:00.447294 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-839ff4f0-1f0e-49de-80f7-c39c54d0cc4e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:00.447995 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-839ff4f0-1f0e-49de-80f7-c39c54d0cc4e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:00.454322 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-839ff4f0-1f0e-49de-80f7-c39c54d0cc4e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:00.454841 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-839ff4f0-1f0e-49de-80f7-c39c54d0cc4e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:00.455403 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-839ff4f0-1f0e-49de-80f7-c39c54d0cc4e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:00.456107 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-839ff4f0-1f0e-49de-80f7-c39c54d0cc4e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:00.456567 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-839ff4f0-1f0e-49de-80f7-c39c54d0cc4e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:00.456993 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-839ff4f0-1f0e-49de-80f7-c39c54d0cc4e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:00.521134 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9dcaa0ab-2816-4ac5-b4b6-bb90533c7e70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:00.521744 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9dcaa0ab-2816-4ac5-b4b6-bb90533c7e70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:00.527992 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9dcaa0ab-2816-4ac5-b4b6-bb90533c7e70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:00.528485 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9dcaa0ab-2816-4ac5-b4b6-bb90533c7e70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:00.528923 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9dcaa0ab-2816-4ac5-b4b6-bb90533c7e70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:00.529622 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9dcaa0ab-2816-4ac5-b4b6-bb90533c7e70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:00.530077 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9dcaa0ab-2816-4ac5-b4b6-bb90533c7e70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:00.530502 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9dcaa0ab-2816-4ac5-b4b6-bb90533c7e70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:00.635891 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-839ff4f0-1f0e-49de-80f7-c39c54d0cc4e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:00.643760 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-839ff4f0-1f0e-49de-80f7-c39c54d0cc4e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1319 microversion: 2.1 time: 0.202008 Sep 18 01:00:00.644331 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 260/518] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:00 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:00.680268 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9dcaa0ab-2816-4ac5-b4b6-bb90533c7e70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:00.689727 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9dcaa0ab-2816-4ac5-b4b6-bb90533c7e70 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.172487 Sep 18 01:00:00.690297 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 259/519] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:00 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:01.444760 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7b0b01a0-51d6-4425-bc5e-9f1fd375ba3c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:01.445402 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7b0b01a0-51d6-4425-bc5e-9f1fd375ba3c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:01.453431 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b0b01a0-51d6-4425-bc5e-9f1fd375ba3c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.454059 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b0b01a0-51d6-4425-bc5e-9f1fd375ba3c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.454338 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b0b01a0-51d6-4425-bc5e-9f1fd375ba3c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.455065 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b0b01a0-51d6-4425-bc5e-9f1fd375ba3c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.455523 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b0b01a0-51d6-4425-bc5e-9f1fd375ba3c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.455946 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b0b01a0-51d6-4425-bc5e-9f1fd375ba3c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.608710 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7b0b01a0-51d6-4425-bc5e-9f1fd375ba3c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:01.618673 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7b0b01a0-51d6-4425-bc5e-9f1fd375ba3c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1367 microversion: 2.1 time: 0.178230 Sep 18 01:00:01.619381 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 261/520] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:01 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:01.667377 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-231883e9-28b6-4503-b92b-c8fcd388f2ed tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:01.668215 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-231883e9-28b6-4503-b92b-c8fcd388f2ed tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:01.676207 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-231883e9-28b6-4503-b92b-c8fcd388f2ed tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.676708 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-231883e9-28b6-4503-b92b-c8fcd388f2ed tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.677141 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-231883e9-28b6-4503-b92b-c8fcd388f2ed tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.678518 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-231883e9-28b6-4503-b92b-c8fcd388f2ed tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.679293 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-231883e9-28b6-4503-b92b-c8fcd388f2ed tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.679827 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-231883e9-28b6-4503-b92b-c8fcd388f2ed tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.716450 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-dbab1581-d755-4ed9-ad40-1eeb4255a5fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:01.717866 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-dbab1581-d755-4ed9-ad40-1eeb4255a5fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:01.725764 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbab1581-d755-4ed9-ad40-1eeb4255a5fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.727220 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbab1581-d755-4ed9-ad40-1eeb4255a5fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.727675 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbab1581-d755-4ed9-ad40-1eeb4255a5fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.728508 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbab1581-d755-4ed9-ad40-1eeb4255a5fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:01.729144 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbab1581-d755-4ed9-ad40-1eeb4255a5fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:01.729562 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbab1581-d755-4ed9-ad40-1eeb4255a5fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:01.996771 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-231883e9-28b6-4503-b92b-c8fcd388f2ed tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:02.004662 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-231883e9-28b6-4503-b92b-c8fcd388f2ed tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1319 microversion: 2.1 time: 0.341632 Sep 18 01:00:02.005235 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 260/521] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:01 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:02.030694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-dbab1581-d755-4ed9-ad40-1eeb4255a5fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:02.039437 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-dbab1581-d755-4ed9-ad40-1eeb4255a5fb tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.329638 Sep 18 01:00:02.040020 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 262/522] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:01 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:02.643971 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d76b63fa-5af8-4ede-a85e-89c90f181bdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:02.644576 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d76b63fa-5af8-4ede-a85e-89c90f181bdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:02.651332 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d76b63fa-5af8-4ede-a85e-89c90f181bdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:02.651813 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d76b63fa-5af8-4ede-a85e-89c90f181bdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:02.652265 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d76b63fa-5af8-4ede-a85e-89c90f181bdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:02.652947 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d76b63fa-5af8-4ede-a85e-89c90f181bdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:02.653397 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d76b63fa-5af8-4ede-a85e-89c90f181bdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:02.653812 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d76b63fa-5af8-4ede-a85e-89c90f181bdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:02.783072 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d76b63fa-5af8-4ede-a85e-89c90f181bdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:02.790762 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d76b63fa-5af8-4ede-a85e-89c90f181bdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1367 microversion: 2.1 time: 0.150634 Sep 18 01:00:02.791344 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 261/523] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:02 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:03.028340 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-89b7964e-6951-4360-bfdd-290df577e115 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:03.029112 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-89b7964e-6951-4360-bfdd-290df577e115 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:03.035686 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-89b7964e-6951-4360-bfdd-290df577e115 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:03.036175 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-89b7964e-6951-4360-bfdd-290df577e115 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:03.036618 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-89b7964e-6951-4360-bfdd-290df577e115 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:03.037312 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-89b7964e-6951-4360-bfdd-290df577e115 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:03.037866 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-89b7964e-6951-4360-bfdd-290df577e115 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:03.038300 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-89b7964e-6951-4360-bfdd-290df577e115 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:03.062829 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7933e53f-c56a-4669-9190-a7ff10009235 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:03.063446 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7933e53f-c56a-4669-9190-a7ff10009235 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:03.070481 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7933e53f-c56a-4669-9190-a7ff10009235 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:03.071009 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7933e53f-c56a-4669-9190-a7ff10009235 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:03.071445 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7933e53f-c56a-4669-9190-a7ff10009235 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:03.072142 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7933e53f-c56a-4669-9190-a7ff10009235 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:03.072592 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7933e53f-c56a-4669-9190-a7ff10009235 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:03.073013 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7933e53f-c56a-4669-9190-a7ff10009235 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:03.222111 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-89b7964e-6951-4360-bfdd-290df577e115 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:03.230604 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-89b7964e-6951-4360-bfdd-290df577e115 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1319 microversion: 2.1 time: 0.206146 Sep 18 01:00:03.231210 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 263/524] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:03 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:03.251195 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7933e53f-c56a-4669-9190-a7ff10009235 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:03.262106 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7933e53f-c56a-4669-9190-a7ff10009235 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.203081 Sep 18 01:00:03.262671 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 262/525] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:03 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:03.813643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-529ac5cd-ca33-4c20-8de3-2c92e01b04b8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:03.814375 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-529ac5cd-ca33-4c20-8de3-2c92e01b04b8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:03.820983 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-529ac5cd-ca33-4c20-8de3-2c92e01b04b8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:03.821593 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-529ac5cd-ca33-4c20-8de3-2c92e01b04b8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:03.822130 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-529ac5cd-ca33-4c20-8de3-2c92e01b04b8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:03.822975 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-529ac5cd-ca33-4c20-8de3-2c92e01b04b8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:03.823517 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-529ac5cd-ca33-4c20-8de3-2c92e01b04b8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:03.824021 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-529ac5cd-ca33-4c20-8de3-2c92e01b04b8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:03.954046 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-6f50827f-1cdc-46d2-aea3-0d29cfaf4e58 req-c504c159-8fd6-4d6e-9f01-d162fb5c0d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27162b19-b4be-4478-8644-79f59ff58586", "name": "network-vif-plugged", "status": "completed", "tag": "676125cb-60fb-496b-b796-92d00340f299"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:03.957466 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-529ac5cd-ca33-4c20-8de3-2c92e01b04b8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:03.966345 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-6f50827f-1cdc-46d2-aea3-0d29cfaf4e58 req-c504c159-8fd6-4d6e-9f01-d162fb5c0d2a service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:03.967301 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-6f50827f-1cdc-46d2-aea3-0d29cfaf4e58 req-c504c159-8fd6-4d6e-9f01-d162fb5c0d2a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:03.968078 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-6f50827f-1cdc-46d2-aea3-0d29cfaf4e58 req-c504c159-8fd6-4d6e-9f01-d162fb5c0d2a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:03.977549 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-529ac5cd-ca33-4c20-8de3-2c92e01b04b8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1367 microversion: 2.1 time: 0.167459 Sep 18 01:00:03.979014 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 264/526] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:03 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:03.982822 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-6f50827f-1cdc-46d2-aea3-0d29cfaf4e58 req-c504c159-8fd6-4d6e-9f01-d162fb5c0d2a service nova] Creating event network-vif-plugged:676125cb-60fb-496b-b796-92d00340f299 for instance 27162b19-b4be-4478-8644-79f59ff58586 on hv-cinder-maste Sep 18 01:00:03.992366 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-6f50827f-1cdc-46d2-aea3-0d29cfaf4e58 req-c504c159-8fd6-4d6e-9f01-d162fb5c0d2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042372 Sep 18 01:00:03.993158 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 263/527] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:04.255271 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f7bb24b6-26f5-4976-a36b-fef77a795e7e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:04.255878 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f7bb24b6-26f5-4976-a36b-fef77a795e7e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:04.258543 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:04.264411 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f7bb24b6-26f5-4976-a36b-fef77a795e7e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:04.264896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f7bb24b6-26f5-4976-a36b-fef77a795e7e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:04.265328 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f7bb24b6-26f5-4976-a36b-fef77a795e7e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:04.266023 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f7bb24b6-26f5-4976-a36b-fef77a795e7e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:04.266476 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f7bb24b6-26f5-4976-a36b-fef77a795e7e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:04.266928 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f7bb24b6-26f5-4976-a36b-fef77a795e7e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:04.285932 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ff06e3cf-d891-48cd-805f-e490ff6aa560 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:04.286633 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ff06e3cf-d891-48cd-805f-e490ff6aa560 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:04.293494 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ff06e3cf-d891-48cd-805f-e490ff6aa560 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:04.293992 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ff06e3cf-d891-48cd-805f-e490ff6aa560 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:04.294429 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ff06e3cf-d891-48cd-805f-e490ff6aa560 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:04.295174 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ff06e3cf-d891-48cd-805f-e490ff6aa560 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:04.295634 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ff06e3cf-d891-48cd-805f-e490ff6aa560 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:04.296064 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ff06e3cf-d891-48cd-805f-e490ff6aa560 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:04.471564 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f7bb24b6-26f5-4976-a36b-fef77a795e7e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:04.480030 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f7bb24b6-26f5-4976-a36b-fef77a795e7e tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1319 microversion: 2.1 time: 0.228896 Sep 18 01:00:04.480637 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 265/528] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:04 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:04.483104 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ff06e3cf-d891-48cd-805f-e490ff6aa560 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:04.492417 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ff06e3cf-d891-48cd-805f-e490ff6aa560 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.210660 Sep 18 01:00:04.493082 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 264/529] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:04 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:05.003596 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e1aaaba4-a810-4b90-aac7-5c896d629247 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:05.004201 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e1aaaba4-a810-4b90-aac7-5c896d629247 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:05.011081 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e1aaaba4-a810-4b90-aac7-5c896d629247 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:05.011568 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e1aaaba4-a810-4b90-aac7-5c896d629247 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:05.012002 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e1aaaba4-a810-4b90-aac7-5c896d629247 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:05.012693 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e1aaaba4-a810-4b90-aac7-5c896d629247 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:05.013156 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e1aaaba4-a810-4b90-aac7-5c896d629247 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:05.013581 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e1aaaba4-a810-4b90-aac7-5c896d629247 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:05.142511 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-e1aaaba4-a810-4b90-aac7-5c896d629247 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:05.150595 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e1aaaba4-a810-4b90-aac7-5c896d629247 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1367 microversion: 2.1 time: 0.151090 Sep 18 01:00:05.151188 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 266/530] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:04 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:05.503708 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-12ebb068-4534-4545-a352-c7ac6fd27276 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:05.504989 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-12ebb068-4534-4545-a352-c7ac6fd27276 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:05.513600 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12ebb068-4534-4545-a352-c7ac6fd27276 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:05.514098 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12ebb068-4534-4545-a352-c7ac6fd27276 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:05.514537 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12ebb068-4534-4545-a352-c7ac6fd27276 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:05.515270 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12ebb068-4534-4545-a352-c7ac6fd27276 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:05.515727 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12ebb068-4534-4545-a352-c7ac6fd27276 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:05.516152 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12ebb068-4534-4545-a352-c7ac6fd27276 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:05.517398 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c1a4dca8-8255-44ab-b04e-9aed52516e6d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:05.518097 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c1a4dca8-8255-44ab-b04e-9aed52516e6d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:05.526909 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1a4dca8-8255-44ab-b04e-9aed52516e6d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:05.527470 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1a4dca8-8255-44ab-b04e-9aed52516e6d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:05.527946 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1a4dca8-8255-44ab-b04e-9aed52516e6d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:05.528653 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1a4dca8-8255-44ab-b04e-9aed52516e6d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:05.529158 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1a4dca8-8255-44ab-b04e-9aed52516e6d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:05.529630 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c1a4dca8-8255-44ab-b04e-9aed52516e6d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:05.666396 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:05.686971 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=8 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:05.725248 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-12ebb068-4534-4545-a352-c7ac6fd27276 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:05.728216 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c1a4dca8-8255-44ab-b04e-9aed52516e6d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:05.733766 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-12ebb068-4534-4545-a352-c7ac6fd27276 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1319 microversion: 2.1 time: 0.234140 Sep 18 01:00:05.734665 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 265/531] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:05 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:05.737200 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c1a4dca8-8255-44ab-b04e-9aed52516e6d tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.224438 Sep 18 01:00:05.737769 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 267/532] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:05 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:06.011153 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-010d13e4-7b6b-4e99-9201-a5634d63ddcb req-63fedef5-134e-48b7-8f86-8ba2a780e15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def988da-b233-4deb-b329-656813dfed41", "name": "network-vif-plugged", "status": "completed", "tag": "1239cb20-24bd-4543-8342-b66e69ae21eb"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:06.020457 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-010d13e4-7b6b-4e99-9201-a5634d63ddcb req-63fedef5-134e-48b7-8f86-8ba2a780e15e service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:06.020938 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-010d13e4-7b6b-4e99-9201-a5634d63ddcb req-63fedef5-134e-48b7-8f86-8ba2a780e15e service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:06.021377 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-010d13e4-7b6b-4e99-9201-a5634d63ddcb req-63fedef5-134e-48b7-8f86-8ba2a780e15e service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:06.032821 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-010d13e4-7b6b-4e99-9201-a5634d63ddcb req-63fedef5-134e-48b7-8f86-8ba2a780e15e service nova] Creating event network-vif-plugged:1239cb20-24bd-4543-8342-b66e69ae21eb for instance def988da-b233-4deb-b329-656813dfed41 on hv-cinder-maste Sep 18 01:00:06.038054 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-010d13e4-7b6b-4e99-9201-a5634d63ddcb req-63fedef5-134e-48b7-8f86-8ba2a780e15e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030014 Sep 18 01:00:06.039044 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 266/533] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:06.174645 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-2c86e962-1031-46da-921d-97c901f42b91 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:06.175311 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-2c86e962-1031-46da-921d-97c901f42b91 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:06.177191 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=12 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:06.183603 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2c86e962-1031-46da-921d-97c901f42b91 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:06.184106 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2c86e962-1031-46da-921d-97c901f42b91 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:06.184547 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2c86e962-1031-46da-921d-97c901f42b91 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:06.185248 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2c86e962-1031-46da-921d-97c901f42b91 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:06.185778 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2c86e962-1031-46da-921d-97c901f42b91 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:06.186209 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2c86e962-1031-46da-921d-97c901f42b91 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:06.377369 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-2c86e962-1031-46da-921d-97c901f42b91 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:06.385699 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-2c86e962-1031-46da-921d-97c901f42b91 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1556 microversion: 2.1 time: 0.214927 Sep 18 01:00:06.386274 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 268/534] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:06 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1556 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:06.408946 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0661b909-76eb-4da4-a0d0-73f0c507fa9a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:06.409533 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0661b909-76eb-4da4-a0d0-73f0c507fa9a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:06.411536 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:06.417521 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0661b909-76eb-4da4-a0d0-73f0c507fa9a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:06.418002 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0661b909-76eb-4da4-a0d0-73f0c507fa9a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:06.418440 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0661b909-76eb-4da4-a0d0-73f0c507fa9a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:06.419155 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0661b909-76eb-4da4-a0d0-73f0c507fa9a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:06.419616 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0661b909-76eb-4da4-a0d0-73f0c507fa9a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:06.420037 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0661b909-76eb-4da4-a0d0-73f0c507fa9a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:06.424123 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=100 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:06.498200 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0661b909-76eb-4da4-a0d0-73f0c507fa9a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093651 Sep 18 01:00:06.498843 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 267/535] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 18 01:00:06 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:06.758189 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-88842f71-47aa-4264-9a51-bdcd91a20640 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:06.758843 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-88842f71-47aa-4264-9a51-bdcd91a20640 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:06.761472 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1a3bf78d-2e6b-431a-9133-e73536958c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:06.762535 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-1a3bf78d-2e6b-431a-9133-e73536958c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:06.765605 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88842f71-47aa-4264-9a51-bdcd91a20640 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:06.766105 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88842f71-47aa-4264-9a51-bdcd91a20640 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:06.766548 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88842f71-47aa-4264-9a51-bdcd91a20640 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:06.767305 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88842f71-47aa-4264-9a51-bdcd91a20640 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:06.767769 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88842f71-47aa-4264-9a51-bdcd91a20640 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:06.768202 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88842f71-47aa-4264-9a51-bdcd91a20640 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:06.768855 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1a3bf78d-2e6b-431a-9133-e73536958c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:06.769352 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1a3bf78d-2e6b-431a-9133-e73536958c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:06.769797 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1a3bf78d-2e6b-431a-9133-e73536958c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:06.770515 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1a3bf78d-2e6b-431a-9133-e73536958c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:06.771006 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1a3bf78d-2e6b-431a-9133-e73536958c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:06.771446 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1a3bf78d-2e6b-431a-9133-e73536958c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:07.117058 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-1a3bf78d-2e6b-431a-9133-e73536958c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:07.119559 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-88842f71-47aa-4264-9a51-bdcd91a20640 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:07.126856 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-1a3bf78d-2e6b-431a-9133-e73536958c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.369167 Sep 18 01:00:07.127648 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 268/536] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:06 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:07.127857 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-88842f71-47aa-4264-9a51-bdcd91a20640 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1319 microversion: 2.1 time: 0.374103 Sep 18 01:00:07.129633 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 269/537] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:06 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:07.825342 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-22917d68-74aa-4768-b83d-994f067ac7ad req-2be08e50-796c-41b4-8163-22a5c831d950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27162b19-b4be-4478-8644-79f59ff58586", "tag": "676125cb-60fb-496b-b796-92d00340f299"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:07.835315 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-22917d68-74aa-4768-b83d-994f067ac7ad req-2be08e50-796c-41b4-8163-22a5c831d950 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:07.835795 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-22917d68-74aa-4768-b83d-994f067ac7ad req-2be08e50-796c-41b4-8163-22a5c831d950 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:07.836221 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-22917d68-74aa-4768-b83d-994f067ac7ad req-2be08e50-796c-41b4-8163-22a5c831d950 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:07.846924 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-22917d68-74aa-4768-b83d-994f067ac7ad req-2be08e50-796c-41b4-8163-22a5c831d950 service nova] Creating event network-changed:676125cb-60fb-496b-b796-92d00340f299 for instance 27162b19-b4be-4478-8644-79f59ff58586 on hv-cinder-maste Sep 18 01:00:07.852577 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-22917d68-74aa-4768-b83d-994f067ac7ad req-2be08e50-796c-41b4-8163-22a5c831d950 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030972 Sep 18 01:00:07.853163 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 269/538] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:08.150762 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-44da97f5-ee29-419b-b94d-42e72b293e56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:08.151491 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-44da97f5-ee29-419b-b94d-42e72b293e56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:08.154308 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-785c96a7-e496-4d63-afe0-2353b3fbe8fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:08.155057 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-785c96a7-e496-4d63-afe0-2353b3fbe8fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:08.158426 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-44da97f5-ee29-419b-b94d-42e72b293e56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.158951 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-44da97f5-ee29-419b-b94d-42e72b293e56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.159389 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-44da97f5-ee29-419b-b94d-42e72b293e56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.160111 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-44da97f5-ee29-419b-b94d-42e72b293e56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.160592 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-44da97f5-ee29-419b-b94d-42e72b293e56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.161015 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-44da97f5-ee29-419b-b94d-42e72b293e56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.161868 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-785c96a7-e496-4d63-afe0-2353b3fbe8fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.163016 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-785c96a7-e496-4d63-afe0-2353b3fbe8fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.163424 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-785c96a7-e496-4d63-afe0-2353b3fbe8fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.164135 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-785c96a7-e496-4d63-afe0-2353b3fbe8fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.164602 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-785c96a7-e496-4d63-afe0-2353b3fbe8fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.165038 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-785c96a7-e496-4d63-afe0-2353b3fbe8fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.361245 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-44da97f5-ee29-419b-b94d-42e72b293e56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:08.371344 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-44da97f5-ee29-419b-b94d-42e72b293e56 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.224879 Sep 18 01:00:08.372875 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-785c96a7-e496-4d63-afe0-2353b3fbe8fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:08.376575 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 270/539] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:08 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:08.383084 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-785c96a7-e496-4d63-afe0-2353b3fbe8fe tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1319 microversion: 2.1 time: 0.233037 Sep 18 01:00:08.383815 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 270/540] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:08 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:08.663743 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-bb18c432-def9-4341-bb29-b0b103cb1701 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:08.664245 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-bb18c432-def9-4341-bb29-b0b103cb1701 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:08.670393 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bb18c432-def9-4341-bb29-b0b103cb1701 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.670924 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bb18c432-def9-4341-bb29-b0b103cb1701 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.671369 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bb18c432-def9-4341-bb29-b0b103cb1701 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.672073 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bb18c432-def9-4341-bb29-b0b103cb1701 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.672532 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bb18c432-def9-4341-bb29-b0b103cb1701 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.672959 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bb18c432-def9-4341-bb29-b0b103cb1701 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.706456 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-bb18c432-def9-4341-bb29-b0b103cb1701 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments/7dafd249-c2c9-4efe-9730-abc1f73242ec" status: 200 len: 194 microversion: 2.20 time: 0.046828 Sep 18 01:00:08.707097 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 271/541] 10.222.0.33 () {60 vars in 1454 bytes} [Sun Sep 18 01:00:08 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments/7dafd249-c2c9-4efe-9730-abc1f73242ec => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:08.777803 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ee40e261-10ea-48a9-8f41-61c563f2c782 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:08.778301 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ee40e261-10ea-48a9-8f41-61c563f2c782 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:08.784662 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ee40e261-10ea-48a9-8f41-61c563f2c782 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.785164 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ee40e261-10ea-48a9-8f41-61c563f2c782 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.785607 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ee40e261-10ea-48a9-8f41-61c563f2c782 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.786320 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ee40e261-10ea-48a9-8f41-61c563f2c782 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.786776 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ee40e261-10ea-48a9-8f41-61c563f2c782 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.787265 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ee40e261-10ea-48a9-8f41-61c563f2c782 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.874641 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-ee40e261-10ea-48a9-8f41-61c563f2c782 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lazy-loading 'services' on Instance uuid c1cf145a-d8d5-4a7e-937b-729bf79629fa {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:08.952145 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ee40e261-10ea-48a9-8f41-61c563f2c782 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments/7dafd249-c2c9-4efe-9730-abc1f73242ec" status: 202 len: 0 microversion: 2.20 time: 0.178370 Sep 18 01:00:08.952857 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 271/542] 10.222.0.33 () {60 vars in 1457 bytes} [Sun Sep 18 01:00:08 2022] DELETE /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments/7dafd249-c2c9-4efe-9730-abc1f73242ec => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:00:08.961586 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-574249d5-5b04-4df5-ae46-91f6649f382d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:08.963950 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-574249d5-5b04-4df5-ae46-91f6649f382d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:08.970090 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-574249d5-5b04-4df5-ae46-91f6649f382d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.970584 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-574249d5-5b04-4df5-ae46-91f6649f382d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.971099 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-574249d5-5b04-4df5-ae46-91f6649f382d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:08.972177 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-574249d5-5b04-4df5-ae46-91f6649f382d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:08.972276 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-574249d5-5b04-4df5-ae46-91f6649f382d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:08.972669 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-574249d5-5b04-4df5-ae46-91f6649f382d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:09.004016 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-574249d5-5b04-4df5-ae46-91f6649f382d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046459 Sep 18 01:00:09.004775 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 272/543] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 18 01:00:08 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:09.397988 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4ed648f0-69e5-47b1-839e-c025dc6000d0 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:09.398679 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-4ed648f0-69e5-47b1-839e-c025dc6000d0 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:09.404972 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4ed648f0-69e5-47b1-839e-c025dc6000d0 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:09.405317 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b21ce873-95f8-4e7a-bc84-f4bd7d2cb736 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:09.405808 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4ed648f0-69e5-47b1-839e-c025dc6000d0 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:09.405943 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4ed648f0-69e5-47b1-839e-c025dc6000d0 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:09.406070 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b21ce873-95f8-4e7a-bc84-f4bd7d2cb736 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:09.406555 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4ed648f0-69e5-47b1-839e-c025dc6000d0 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:09.407032 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4ed648f0-69e5-47b1-839e-c025dc6000d0 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:09.407456 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4ed648f0-69e5-47b1-839e-c025dc6000d0 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:09.413122 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b21ce873-95f8-4e7a-bc84-f4bd7d2cb736 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:09.413891 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b21ce873-95f8-4e7a-bc84-f4bd7d2cb736 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:09.414922 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b21ce873-95f8-4e7a-bc84-f4bd7d2cb736 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:09.415823 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b21ce873-95f8-4e7a-bc84-f4bd7d2cb736 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:09.416587 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b21ce873-95f8-4e7a-bc84-f4bd7d2cb736 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:09.417203 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b21ce873-95f8-4e7a-bc84-f4bd7d2cb736 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:09.597077 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-4ed648f0-69e5-47b1-839e-c025dc6000d0 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:09.606227 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-4ed648f0-69e5-47b1-839e-c025dc6000d0 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.213209 Sep 18 01:00:09.606814 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 272/544] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:09 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:09.611001 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b21ce873-95f8-4e7a-bc84-f4bd7d2cb736 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:09.618682 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b21ce873-95f8-4e7a-bc84-f4bd7d2cb736 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1509 microversion: 2.1 time: 0.217286 Sep 18 01:00:09.619286 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 273/545] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:09 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:09.641286 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-44a67495-4118-45b1-b416-13a5d5b4a9cc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1f87766-62a6-48bd-a5c9-9734a6c65bdf", "device": "/dev/sdb"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:09.643791 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-44a67495-4118-45b1-b416-13a5d5b4a9cc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:09.650434 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44a67495-4118-45b1-b416-13a5d5b4a9cc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:09.650883 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44a67495-4118-45b1-b416-13a5d5b4a9cc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:09.651321 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44a67495-4118-45b1-b416-13a5d5b4a9cc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:09.652109 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44a67495-4118-45b1-b416-13a5d5b4a9cc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:09.652561 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44a67495-4118-45b1-b416-13a5d5b4a9cc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:09.652978 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-44a67495-4118-45b1-b416-13a5d5b4a9cc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:10.017276 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-868d3f4a-4480-47ef-bfd5-f8eb61c41126 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:10.019876 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-868d3f4a-4480-47ef-bfd5-f8eb61c41126 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:10.027224 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-868d3f4a-4480-47ef-bfd5-f8eb61c41126 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:10.028298 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-868d3f4a-4480-47ef-bfd5-f8eb61c41126 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:10.028765 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-868d3f4a-4480-47ef-bfd5-f8eb61c41126 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:10.029758 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-868d3f4a-4480-47ef-bfd5-f8eb61c41126 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:10.030323 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-868d3f4a-4480-47ef-bfd5-f8eb61c41126 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:10.030914 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-868d3f4a-4480-47ef-bfd5-f8eb61c41126 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:10.036707 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-44a67495-4118-45b1-b416-13a5d5b4a9cc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "POST /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399193 Sep 18 01:00:10.042839 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 273/546] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 01:00:09 2022] POST /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:10.062133 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-868d3f4a-4480-47ef-bfd5-f8eb61c41126 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049033 Sep 18 01:00:10.062910 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 274/547] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 18 01:00:10 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:00:10.630513 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-5c236d75-f228-4ba8-96aa-d4036c86778b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:10.631300 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-5c236d75-f228-4ba8-96aa-d4036c86778b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:10.637475 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c236d75-f228-4ba8-96aa-d4036c86778b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:10.637963 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c236d75-f228-4ba8-96aa-d4036c86778b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:10.638406 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c236d75-f228-4ba8-96aa-d4036c86778b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:10.639128 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c236d75-f228-4ba8-96aa-d4036c86778b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:10.639595 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c236d75-f228-4ba8-96aa-d4036c86778b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:10.640025 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c236d75-f228-4ba8-96aa-d4036c86778b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:10.806633 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-5c236d75-f228-4ba8-96aa-d4036c86778b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:10.814980 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-5c236d75-f228-4ba8-96aa-d4036c86778b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1737 microversion: 2.1 time: 0.189160 Sep 18 01:00:10.815551 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 274/548] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:10 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:11.075501 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-21ab387d-1bbb-4ba5-b266-d7735a7a24ae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:11.077643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-21ab387d-1bbb-4ba5-b266-d7735a7a24ae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:11.084212 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21ab387d-1bbb-4ba5-b266-d7735a7a24ae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.084803 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21ab387d-1bbb-4ba5-b266-d7735a7a24ae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.085244 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21ab387d-1bbb-4ba5-b266-d7735a7a24ae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.085938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21ab387d-1bbb-4ba5-b266-d7735a7a24ae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.086398 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21ab387d-1bbb-4ba5-b266-d7735a7a24ae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.086851 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-21ab387d-1bbb-4ba5-b266-d7735a7a24ae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.089222 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=100 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:11.118029 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-21ab387d-1bbb-4ba5-b266-d7735a7a24ae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046479 Sep 18 01:00:11.118603 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 275/549] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 18 01:00:11 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:11.837842 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-5c7a0416-6cf1-4efe-9fba-abf5355517d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:11.838537 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-5c7a0416-6cf1-4efe-9fba-abf5355517d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:11.845048 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c7a0416-6cf1-4efe-9fba-abf5355517d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.845545 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c7a0416-6cf1-4efe-9fba-abf5355517d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.845980 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c7a0416-6cf1-4efe-9fba-abf5355517d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.846665 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c7a0416-6cf1-4efe-9fba-abf5355517d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:11.847155 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c7a0416-6cf1-4efe-9fba-abf5355517d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:11.847575 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5c7a0416-6cf1-4efe-9fba-abf5355517d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:11.989740 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-5c7a0416-6cf1-4efe-9fba-abf5355517d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:11.999099 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-5c7a0416-6cf1-4efe-9fba-abf5355517d2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1717 microversion: 2.1 time: 0.165538 Sep 18 01:00:11.999664 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 275/550] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:11 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1717 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:12.108129 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:12.108655 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:12.115717 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.116298 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.116734 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.117432 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.117893 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.118323 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.130667 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-816a445d-398d-4fd7-bc85-a57f7f7401e2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:12.133038 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-816a445d-398d-4fd7-bc85-a57f7f7401e2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:12.139141 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-816a445d-398d-4fd7-bc85-a57f7f7401e2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.139629 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-816a445d-398d-4fd7-bc85-a57f7f7401e2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.140069 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-816a445d-398d-4fd7-bc85-a57f7f7401e2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.140767 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-816a445d-398d-4fd7-bc85-a57f7f7401e2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.141224 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-816a445d-398d-4fd7-bc85-a57f7f7401e2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.141650 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-816a445d-398d-4fd7-bc85-a57f7f7401e2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.173718 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-816a445d-398d-4fd7-bc85-a57f7f7401e2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046947 Sep 18 01:00:12.174500 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 276/551] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 18 01:00:12 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:00:12.205748 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] HTTP exception thrown: Cannot 'detach_volume' instance ecc591cc-e74d-48ea-85e8-945b2995d123 while it is in vm_state rescued Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Request method failure captured: Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: DELETE /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments/513ece0f-895c-4c87-b700-09bc943f03f0 HTTP/1.1 Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy31mVmknuEEFVFaU-1XS-k0H1_yKxD0sx28JFsSSlFMJsEGR28zy2XJpRMQQN1x9OLqPLv25JxF5nxicUtHMc-A7k80RvI3QkvK9qwQ0XmK7UZaXL5gu4ruu-xgYOgeYvpm0dpbuXBtjB2YPKKLVqNnntObPsdpKJX6vJQT6ziakM Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: 8cbf74b218c04911bb921f7cc2c6e966 Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:00:12.207381 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:00:12.208811 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8cbf74b218c04911bb921f7cc2c6e966"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8cbf74b218c04911bb921f7cc2c6e966"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8cbf74b218c04911bb921f7cc2c6e966", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8cbf74b218c04911bb921f7cc2c6e966"}]}] Sep 18 01:00:12.208811 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:00:12.208811 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: 8cbf74b218c04911bb921f7cc2c6e966 Sep 18 01:00:12.208811 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:00:12.208811 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-ServerRescueNegativeTestJSON-233879556-project Sep 18 01:00:12.208811 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:00:12.208811 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:00:12.208811 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 4d84f31e15924d3c8dbd7aac8a0f3576 Sep 18 01:00:12.208811 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-ServerRescueNegativeTestJSON-233879556-project Sep 18 01:00:12.208811 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:00:12.208811 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Cannot 'detach_volume' instance ecc591cc-e74d-48ea-85e8-945b2995d123 while it is in vm_state rescued Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'server_id': 'ecc591cc-e74d-48ea-85e8-945b2995d123', 'id': '513ece0f-895c-4c87-b700-09bc943f03f0'} Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ecc591cc-e74d-48ea-85e8-945b2995d123 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:12.210193 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ecc591cc-e74d-48ea-85e8-945b2995d123 while it is in vm_state rescued Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ecc591cc-e74d-48ea-85e8-945b2995d123 while it is in vm_state rescued Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:00:12.211655 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Returning 409 to user: Cannot 'detach_volume' instance ecc591cc-e74d-48ea-85e8-945b2995d123 while it is in vm_state rescued {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:12.212705 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-17989927-cc8e-4720-987c-b49ecdc45b5a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments/513ece0f-895c-4c87-b700-09bc943f03f0" status: 409 len: 152 microversion: 2.1 time: 0.104750 Sep 18 01:00:12.212705 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 276/552] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 01:00:12 2022] DELETE /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments/513ece0f-895c-4c87-b700-09bc943f03f0 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 18 01:00:12.218941 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-499e2637-085f-4220-a96e-0f6a45940880 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:12.219483 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-499e2637-085f-4220-a96e-0f6a45940880 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:12.225655 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-499e2637-085f-4220-a96e-0f6a45940880 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.226143 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-499e2637-085f-4220-a96e-0f6a45940880 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.226585 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-499e2637-085f-4220-a96e-0f6a45940880 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.227366 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-499e2637-085f-4220-a96e-0f6a45940880 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.227825 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-499e2637-085f-4220-a96e-0f6a45940880 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.228255 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-499e2637-085f-4220-a96e-0f6a45940880 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.292835 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-499e2637-085f-4220-a96e-0f6a45940880 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "POST /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/action" status: 202 len: 0 microversion: 2.1 time: 0.077770 Sep 18 01:00:12.293457 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 277/553] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 01:00:12 2022] POST /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:00:12.301711 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a44cf0cd-8c31-4430-959a-26285fd9cb0e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:12.302331 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a44cf0cd-8c31-4430-959a-26285fd9cb0e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:12.309775 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a44cf0cd-8c31-4430-959a-26285fd9cb0e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.310273 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a44cf0cd-8c31-4430-959a-26285fd9cb0e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.310715 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a44cf0cd-8c31-4430-959a-26285fd9cb0e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.311437 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a44cf0cd-8c31-4430-959a-26285fd9cb0e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:12.311902 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a44cf0cd-8c31-4430-959a-26285fd9cb0e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:12.312335 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a44cf0cd-8c31-4430-959a-26285fd9cb0e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:12.539692 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a44cf0cd-8c31-4430-959a-26285fd9cb0e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:12.548749 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a44cf0cd-8c31-4430-959a-26285fd9cb0e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1725 microversion: 2.1 time: 0.250817 Sep 18 01:00:12.549388 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 277/554] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:12 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:13.189738 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-6ca790a4-f780-48c5-8122-7c425b40b961 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:13.192313 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6ca790a4-f780-48c5-8122-7c425b40b961 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:13.199393 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ca790a4-f780-48c5-8122-7c425b40b961 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:13.200157 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ca790a4-f780-48c5-8122-7c425b40b961 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:13.200616 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ca790a4-f780-48c5-8122-7c425b40b961 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:13.201311 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ca790a4-f780-48c5-8122-7c425b40b961 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:13.201769 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ca790a4-f780-48c5-8122-7c425b40b961 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:13.202193 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ca790a4-f780-48c5-8122-7c425b40b961 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:13.233279 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-6ca790a4-f780-48c5-8122-7c425b40b961 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050102 Sep 18 01:00:13.234045 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 278/555] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 18 01:00:13 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:13.302080 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7b88b529-f598-43c4-bde9-962582d50efa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:13.303279 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7b88b529-f598-43c4-bde9-962582d50efa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:13.309815 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b88b529-f598-43c4-bde9-962582d50efa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:13.310297 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b88b529-f598-43c4-bde9-962582d50efa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:13.310726 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b88b529-f598-43c4-bde9-962582d50efa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:13.311435 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b88b529-f598-43c4-bde9-962582d50efa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:13.311896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b88b529-f598-43c4-bde9-962582d50efa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:13.312320 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7b88b529-f598-43c4-bde9-962582d50efa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:13.338047 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7b88b529-f598-43c4-bde9-962582d50efa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Going to try to terminate instance {{(pid=120687) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:00:13.414041 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7b88b529-f598-43c4-bde9-962582d50efa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 204 len: 0 microversion: 2.20 time: 0.115726 Sep 18 01:00:13.414625 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 278/556] 10.222.0.33 () {60 vars in 1280 bytes} [Sun Sep 18 01:00:13 2022] DELETE /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:00:13.422731 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:13.423377 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:13.429889 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:13.430373 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:13.430854 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:13.431545 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:13.432003 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:13.432428 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:13.560204 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:13.568855 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:13.570301 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:13.571496 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-309bd41b-6332-4302-a3a0-784336e00860 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.152639 Sep 18 01:00:13.572046 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 279/557] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:13 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:13.575386 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5f6b7d6c-891e-4ead-bb0e-ca578a809efa tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:13.576088 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5f6b7d6c-891e-4ead-bb0e-ca578a809efa tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:13.582407 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f6b7d6c-891e-4ead-bb0e-ca578a809efa tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:13.583032 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f6b7d6c-891e-4ead-bb0e-ca578a809efa tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:13.583606 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f6b7d6c-891e-4ead-bb0e-ca578a809efa tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:13.585354 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f6b7d6c-891e-4ead-bb0e-ca578a809efa tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:13.586103 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f6b7d6c-891e-4ead-bb0e-ca578a809efa tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:13.586601 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f6b7d6c-891e-4ead-bb0e-ca578a809efa tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:13.728404 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5f6b7d6c-891e-4ead-bb0e-ca578a809efa tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:13.736818 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5f6b7d6c-891e-4ead-bb0e-ca578a809efa tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1725 microversion: 2.1 time: 0.168719 Sep 18 01:00:13.737388 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 279/558] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:13 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:14.597519 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:14.598125 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:14.605221 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.605720 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.606151 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.606859 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.607316 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.607742 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.734084 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:14.742845 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:14.744284 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:14.745446 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f78ceb11-0b83-44be-9f35-d64f74d117d2 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.151847 Sep 18 01:00:14.746020 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 280/559] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:14 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:14.761123 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d12e5bc0-c031-4633-8922-363b74435542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:14.761772 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d12e5bc0-c031-4633-8922-363b74435542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:14.768317 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d12e5bc0-c031-4633-8922-363b74435542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.768805 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d12e5bc0-c031-4633-8922-363b74435542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.769246 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d12e5bc0-c031-4633-8922-363b74435542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.769939 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d12e5bc0-c031-4633-8922-363b74435542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:14.770398 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d12e5bc0-c031-4633-8922-363b74435542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:14.770845 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d12e5bc0-c031-4633-8922-363b74435542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:14.899159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d12e5bc0-c031-4633-8922-363b74435542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:14.907731 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d12e5bc0-c031-4633-8922-363b74435542 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1725 microversion: 2.1 time: 0.150427 Sep 18 01:00:14.908303 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 280/560] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:14 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:15.771066 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:15.773031 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:15.780275 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:15.780996 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:15.781755 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:15.782619 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:15.783266 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:15.783851 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:15.831133 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-c3b5bf6b-fcd6-4921-9aff-b4ed8b164812 req-d32cc1ac-6d1d-4f3a-8a5a-a449d499e91e admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e1f87766-62a6-48bd-a5c9-9734a6c65bdf", "create_info": {"type": "qcow2", "new_file": "volume-e1f87766-62a6-48bd-a5c9-9734a6c65bdf.54decb59-69a1-4eb9-a85a-878680a37578.vhdx", "snapshot_id": "54decb59-69a1-4eb9-a85a-878680a37578"}}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:15.835363 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-c3b5bf6b-fcd6-4921-9aff-b4ed8b164812 req-d32cc1ac-6d1d-4f3a-8a5a-a449d499e91e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:15.835964 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-c3b5bf6b-fcd6-4921-9aff-b4ed8b164812 req-d32cc1ac-6d1d-4f3a-8a5a-a449d499e91e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:15.836499 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-c3b5bf6b-fcd6-4921-9aff-b4ed8b164812 req-d32cc1ac-6d1d-4f3a-8a5a-a449d499e91e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:15.845637 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-c3b5bf6b-fcd6-4921-9aff-b4ed8b164812 req-d32cc1ac-6d1d-4f3a-8a5a-a449d499e91e admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:15.846283 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-c3b5bf6b-fcd6-4921-9aff-b4ed8b164812 req-d32cc1ac-6d1d-4f3a-8a5a-a449d499e91e admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:15.846832 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-c3b5bf6b-fcd6-4921-9aff-b4ed8b164812 req-d32cc1ac-6d1d-4f3a-8a5a-a449d499e91e admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:15.861781 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-c3b5bf6b-fcd6-4921-9aff-b4ed8b164812 req-d32cc1ac-6d1d-4f3a-8a5a-a449d499e91e admin admin] 10.222.0.57 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.094336 Sep 18 01:00:15.862553 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 281/561] 10.222.0.57 () {64 vars in 1326 bytes} [Sun Sep 18 01:00:15 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:00:15.931923 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-14121037-78e6-4b86-9541-9886bac8a30e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:15.932693 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-14121037-78e6-4b86-9541-9886bac8a30e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:15.939325 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-14121037-78e6-4b86-9541-9886bac8a30e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:15.939892 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-14121037-78e6-4b86-9541-9886bac8a30e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:15.940427 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-14121037-78e6-4b86-9541-9886bac8a30e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:15.941129 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-14121037-78e6-4b86-9541-9886bac8a30e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:15.941585 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-14121037-78e6-4b86-9541-9886bac8a30e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:15.942043 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-14121037-78e6-4b86-9541-9886bac8a30e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:15.967067 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:16.081818 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:16.090396 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:16.091893 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:16.093088 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b5194327-2876-48d8-b21b-563422280acf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1724 microversion: 2.20 time: 0.325906 Sep 18 01:00:16.093774 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 281/562] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:15 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:16.212745 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-14121037-78e6-4b86-9541-9886bac8a30e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:16.221098 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-14121037-78e6-4b86-9541-9886bac8a30e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1725 microversion: 2.1 time: 0.293386 Sep 18 01:00:16.221756 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 282/563] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:15 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:16.720123 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-ea05fc86-20bb-4798-a28b-8d656ed0a5b7 req-002a50f8-eb8a-4e1e-8036-5640572aeb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cf145a-d8d5-4a7e-937b-729bf79629fa", "name": "network-vif-deleted", "tag": "3b10ed6a-bc95-40e6-afaa-4936e44594eb"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:16.729802 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ea05fc86-20bb-4798-a28b-8d656ed0a5b7 req-002a50f8-eb8a-4e1e-8036-5640572aeb61 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:16.730314 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ea05fc86-20bb-4798-a28b-8d656ed0a5b7 req-002a50f8-eb8a-4e1e-8036-5640572aeb61 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:16.730747 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ea05fc86-20bb-4798-a28b-8d656ed0a5b7 req-002a50f8-eb8a-4e1e-8036-5640572aeb61 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:16.742713 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-ea05fc86-20bb-4798-a28b-8d656ed0a5b7 req-002a50f8-eb8a-4e1e-8036-5640572aeb61 service nova] Creating event network-vif-deleted:3b10ed6a-bc95-40e6-afaa-4936e44594eb for instance c1cf145a-d8d5-4a7e-937b-729bf79629fa on hv-cinder-maste Sep 18 01:00:16.747925 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-ea05fc86-20bb-4798-a28b-8d656ed0a5b7 req-002a50f8-eb8a-4e1e-8036-5640572aeb61 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031408 Sep 18 01:00:16.748521 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 282/564] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:17.120001 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:17.120544 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:17.127265 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:17.127750 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:17.128197 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:17.128869 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:17.129321 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:17.129744 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:17.193218 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:17.201460 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:17.202925 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:17.204081 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a810d64d-0ffd-497d-b6cb-05683e5c3d80 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1657 microversion: 2.20 time: 0.088718 Sep 18 01:00:17.204642 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 283/565] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:17 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1657 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:17.245441 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-73bbec18-10bd-40ed-a14d-25991cfbf820 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:17.246185 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-73bbec18-10bd-40ed-a14d-25991cfbf820 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:17.252563 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-73bbec18-10bd-40ed-a14d-25991cfbf820 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:17.253054 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-73bbec18-10bd-40ed-a14d-25991cfbf820 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:17.253491 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-73bbec18-10bd-40ed-a14d-25991cfbf820 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:17.254185 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-73bbec18-10bd-40ed-a14d-25991cfbf820 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:17.254643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-73bbec18-10bd-40ed-a14d-25991cfbf820 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:17.255138 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-73bbec18-10bd-40ed-a14d-25991cfbf820 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:17.389730 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-73bbec18-10bd-40ed-a14d-25991cfbf820 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:17.398113 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-73bbec18-10bd-40ed-a14d-25991cfbf820 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1725 microversion: 2.1 time: 0.157423 Sep 18 01:00:17.398677 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 283/566] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:17 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:18.231394 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:18.231924 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:18.238375 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:18.238907 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:18.239365 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:18.240262 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:18.240721 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:18.241149 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:18.303042 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:18.311351 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:18.312798 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:18.313938 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-740eea92-abeb-41b7-95f1-e4d02fc6d08c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1366 microversion: 2.20 time: 0.086542 Sep 18 01:00:18.314499 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 284/567] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:18 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:18.421726 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-ccb1767d-7284-401b-a821-3180e99e7dd2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:18.422336 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-ccb1767d-7284-401b-a821-3180e99e7dd2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:18.428919 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ccb1767d-7284-401b-a821-3180e99e7dd2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:18.429405 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ccb1767d-7284-401b-a821-3180e99e7dd2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:18.429838 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ccb1767d-7284-401b-a821-3180e99e7dd2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:18.430528 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ccb1767d-7284-401b-a821-3180e99e7dd2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:18.431029 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ccb1767d-7284-401b-a821-3180e99e7dd2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:18.431446 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ccb1767d-7284-401b-a821-3180e99e7dd2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:18.560823 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ccb1767d-7284-401b-a821-3180e99e7dd2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:18.571782 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-ccb1767d-7284-401b-a821-3180e99e7dd2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1725 microversion: 2.1 time: 0.153497 Sep 18 01:00:18.572530 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 284/568] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:18 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:19.340413 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:19.341078 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:19.347538 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:19.348026 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:19.348467 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:19.349282 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:19.349744 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:19.350175 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:19.381058 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:19.381543 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:19.381979 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:19.382431 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lazy-loading 'fault' on Instance uuid c1cf145a-d8d5-4a7e-937b-729bf79629fa {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:19.426434 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:19.435522 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:19.436968 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:19.438131 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9eea35a6-4a84-4145-990a-f0c2f2f5c5aa tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 200 len: 1371 microversion: 2.20 time: 0.101804 Sep 18 01:00:19.438690 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 285/569] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:19 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:19.595577 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c6a6cba6-19d5-442c-8285-3257ee527303 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:19.596141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c6a6cba6-19d5-442c-8285-3257ee527303 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:19.603016 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6a6cba6-19d5-442c-8285-3257ee527303 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:19.603542 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6a6cba6-19d5-442c-8285-3257ee527303 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:19.604010 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6a6cba6-19d5-442c-8285-3257ee527303 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:19.604806 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6a6cba6-19d5-442c-8285-3257ee527303 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:19.605269 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6a6cba6-19d5-442c-8285-3257ee527303 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:19.605690 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6a6cba6-19d5-442c-8285-3257ee527303 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:19.736778 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c6a6cba6-19d5-442c-8285-3257ee527303 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:19.745839 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c6a6cba6-19d5-442c-8285-3257ee527303 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1731 microversion: 2.1 time: 0.154076 Sep 18 01:00:19.746681 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 285/570] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:19 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:19.772451 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-bfb8e9b1-6c58-42cc-aacd-1c6662cbe90e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:19.773144 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-bfb8e9b1-6c58-42cc-aacd-1c6662cbe90e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:19.779220 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bfb8e9b1-6c58-42cc-aacd-1c6662cbe90e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:19.779803 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bfb8e9b1-6c58-42cc-aacd-1c6662cbe90e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:19.780504 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bfb8e9b1-6c58-42cc-aacd-1c6662cbe90e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:19.781269 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bfb8e9b1-6c58-42cc-aacd-1c6662cbe90e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:19.781736 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bfb8e9b1-6c58-42cc-aacd-1c6662cbe90e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:19.782162 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bfb8e9b1-6c58-42cc-aacd-1c6662cbe90e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:19.863247 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-bfb8e9b1-6c58-42cc-aacd-1c6662cbe90e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095234 Sep 18 01:00:19.863845 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 286/571] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 18 01:00:19 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:20.152532 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-e96421d3-ee45-441f-8c09-648503ae37a2 req-aff0cc14-8d08-4e7b-a7ee-d84b48f7f44e admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e1f87766-62a6-48bd-a5c9-9734a6c65bdf", "create_info": {"type": "qcow2", "new_file": "volume-e1f87766-62a6-48bd-a5c9-9734a6c65bdf.010696f8-b160-4b88-a531-f94574a5ba43.vhdx", "snapshot_id": "010696f8-b160-4b88-a531-f94574a5ba43"}}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:20.156491 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-e96421d3-ee45-441f-8c09-648503ae37a2 req-aff0cc14-8d08-4e7b-a7ee-d84b48f7f44e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:20.157153 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-e96421d3-ee45-441f-8c09-648503ae37a2 req-aff0cc14-8d08-4e7b-a7ee-d84b48f7f44e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:20.157597 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-e96421d3-ee45-441f-8c09-648503ae37a2 req-aff0cc14-8d08-4e7b-a7ee-d84b48f7f44e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:20.167137 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-e96421d3-ee45-441f-8c09-648503ae37a2 req-aff0cc14-8d08-4e7b-a7ee-d84b48f7f44e admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:20.167966 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-e96421d3-ee45-441f-8c09-648503ae37a2 req-aff0cc14-8d08-4e7b-a7ee-d84b48f7f44e admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:20.168389 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-e96421d3-ee45-441f-8c09-648503ae37a2 req-aff0cc14-8d08-4e7b-a7ee-d84b48f7f44e admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:20.181846 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-e96421d3-ee45-441f-8c09-648503ae37a2 req-aff0cc14-8d08-4e7b-a7ee-d84b48f7f44e admin admin] 10.222.0.57 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.087246 Sep 18 01:00:20.182451 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 286/572] 10.222.0.57 () {64 vars in 1326 bytes} [Sun Sep 18 01:00:20 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:00:20.466815 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:20.468332 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:20.477530 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:20.478283 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:20.478918 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:20.479818 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:20.480441 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:20.481021 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:20.498343 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] HTTP exception thrown: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Request method failure captured: Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa HTTP/1.1 Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmyuVGWRexS2PbnfIZVzHCEKEDuW80MAPn6A4iqmdaZYwgQ9r3ERbub_kLmtghXj_YX-Y0HG09NdARKXyoYCRfGNv3S6vRMmQnpQZ4M0IM2Ke86b4eRIZej5aBHmaOY4KcNRffe4X_y9tCdHNWColvCfjsYQEEorQt_MIrc75fB7M1M Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:00:20.500345 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a7f6c917c934c00a862b9946ce2b1cd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}] Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 1044cd9cbbe1497aae1939fe81f3f9a5 Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:00:20.501963 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'c1cf145a-d8d5-4a7e-937b-729bf79629fa'} Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:20.502866 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:00:20.504187 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:20.506108 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Returning 404 to user: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:20.506108 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b8eebba8-4ebf-43c4-8134-2dfed5ebec2a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 404 len: 111 microversion: 2.20 time: 0.041765 Sep 18 01:00:20.507590 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 287/573] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:20 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:00:20.514013 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-038ff95d-df2e-4aef-b40e-5d5961f75208 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '.version_select at 0x7f5672a4a9d0>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:20.540254 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-038ff95d-df2e-4aef-b40e-5d5961f75208 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706853748" status: 204 len: 0 microversion: 2.20 time: 0.031214 Sep 18 01:00:20.540850 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 287/574] 10.222.0.33 () {60 vars in 1262 bytes} [Sun Sep 18 01:00:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706853748 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:00:20.827562 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-d974bd5c-5538-488f-b668-0f944f35f6e2 req-361cc79b-4491-4c07-ab80-44cfa6b07fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc591cc-e74d-48ea-85e8-945b2995d123", "tag": "9608eb83-8531-414f-a482-f625b3b31cb2"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:20.838350 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-d974bd5c-5538-488f-b668-0f944f35f6e2 req-361cc79b-4491-4c07-ab80-44cfa6b07fa9 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:20.839108 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-d974bd5c-5538-488f-b668-0f944f35f6e2 req-361cc79b-4491-4c07-ab80-44cfa6b07fa9 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:20.839724 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-d974bd5c-5538-488f-b668-0f944f35f6e2 req-361cc79b-4491-4c07-ab80-44cfa6b07fa9 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:20.852007 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-d974bd5c-5538-488f-b668-0f944f35f6e2 req-361cc79b-4491-4c07-ab80-44cfa6b07fa9 service nova] Creating event network-changed:9608eb83-8531-414f-a482-f625b3b31cb2 for instance ecc591cc-e74d-48ea-85e8-945b2995d123 on hv-cinder-maste Sep 18 01:00:20.857070 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-d974bd5c-5538-488f-b668-0f944f35f6e2 req-361cc79b-4491-4c07-ab80-44cfa6b07fa9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034542 Sep 18 01:00:20.857653 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 288/575] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:21.244602 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9003198e-3193-4dfc-8a98-795306c81bad tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Action: 'create', calling method: .version_select at 0x7f5672a77e50>, body: {"keypair": {"name": "tempest-keypair-157516840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8sVV0uEFhGe/8qix549GrZlgAOTR4mlarTZoOucjcyKwkVwd05Svh+I7/nOvXiSHlElH6MLXxFxJXPRDEqDPaj92TOJ40VEMG9QSL72eZOsaGS2Nd2a3bG146nZK8eIw=="}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:21.266620 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-9003198e-3193-4dfc-8a98-795306c81bad tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Getting quotas for project 1a7f6c917c934c00a862b9946ce2b1cd. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:21.272905 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-9003198e-3193-4dfc-8a98-795306c81bad tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Getting quotas for user 1044cd9cbbe1497aae1939fe81f3f9a5 and project 1a7f6c917c934c00a862b9946ce2b1cd. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:21.283800 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:21.299544 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9003198e-3193-4dfc-8a98-795306c81bad tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.059366 Sep 18 01:00:21.300275 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 288/576] 10.222.0.33 () {62 vars in 1200 bytes} [Sun Sep 18 01:00:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 18 01:00:22.874225 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-e4cb29f9-00f8-457f-94f1-4ec5b4b88ebc req-01a157db-83a2-4e42-b32f-a291dab1d42f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc591cc-e74d-48ea-85e8-945b2995d123", "tag": "9608eb83-8531-414f-a482-f625b3b31cb2"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:22.887740 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-e4cb29f9-00f8-457f-94f1-4ec5b4b88ebc req-01a157db-83a2-4e42-b32f-a291dab1d42f service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:22.894037 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-e4cb29f9-00f8-457f-94f1-4ec5b4b88ebc req-01a157db-83a2-4e42-b32f-a291dab1d42f service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:22.894773 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-e4cb29f9-00f8-457f-94f1-4ec5b4b88ebc req-01a157db-83a2-4e42-b32f-a291dab1d42f service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:22.899762 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2001812821", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b2870f5-1df6-4588-9304-3be88fc2aeec"}], "security_groups": [{"name": "tempest-securitygroup--1537591311"}], "key_name": "tempest-keypair-157516840", "user_data": "}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:22.907328 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-e4cb29f9-00f8-457f-94f1-4ec5b4b88ebc req-01a157db-83a2-4e42-b32f-a291dab1d42f service nova] Creating event network-changed:9608eb83-8531-414f-a482-f625b3b31cb2 for instance ecc591cc-e74d-48ea-85e8-945b2995d123 on hv-cinder-maste Sep 18 01:00:22.914671 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-e4cb29f9-00f8-457f-94f1-4ec5b4b88ebc req-01a157db-83a2-4e42-b32f-a291dab1d42f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045427 Sep 18 01:00:22.915893 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 289/577] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:23.060075 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] validate_networks() for [('5b2870f5-1df6-4588-9304-3be88fc2aeec', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:00:23.222965 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-138268a2-f78d-43c4-add9-18ce73fd3523 req-827b3b80-eafb-4d2e-9d61-829701bb4e13 admin admin] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:23.226319 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-138268a2-f78d-43c4-add9-18ce73fd3523 req-827b3b80-eafb-4d2e-9d61-829701bb4e13 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:23.226839 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-138268a2-f78d-43c4-add9-18ce73fd3523 req-827b3b80-eafb-4d2e-9d61-829701bb4e13 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:23.227253 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-138268a2-f78d-43c4-add9-18ce73fd3523 req-827b3b80-eafb-4d2e-9d61-829701bb4e13 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:23.235506 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-138268a2-f78d-43c4-add9-18ce73fd3523 req-827b3b80-eafb-4d2e-9d61-829701bb4e13 admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:23.235986 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-138268a2-f78d-43c4-add9-18ce73fd3523 req-827b3b80-eafb-4d2e-9d61-829701bb4e13 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:23.236421 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-138268a2-f78d-43c4-add9-18ce73fd3523 req-827b3b80-eafb-4d2e-9d61-829701bb4e13 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:23.250680 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-138268a2-f78d-43c4-add9-18ce73fd3523 req-827b3b80-eafb-4d2e-9d61-829701bb4e13 admin admin] 10.222.0.57 "DELETE /compute/v2.1/os-assisted-volume-snapshots/010696f8-b160-4b88-a531-f94574a5ba43?delete_info=%7B%22file_to_merge%22:%20%22volume-e1f87766-62a6-48bd-a5c9-9734a6c65bdf.010696f8-b160-4b88-a531-f94574a5ba43.vhdx%22,%20%22volume_id%22:%20%22e1f87766-62a6-48bd-a5c9-9734a6c65bdf%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.080687 Sep 18 01:00:23.251300 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 290/578] 10.222.0.57 () {62 vars in 1800 bytes} [Sun Sep 18 01:00:23 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/010696f8-b160-4b88-a531-f94574a5ba43?delete_info=%7B%22file_to_merge%22:%20%22volume-e1f87766-62a6-48bd-a5c9-9734a6c65bdf.010696f8-b160-4b88-a531-f94574a5ba43.vhdx%22,%20%22volume_id%22:%20%22e1f87766-62a6-48bd-a5c9-9734a6c65bdf%22%7D => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:00:23.771721 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:00:23.772146 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:00:23.772679 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:00:23.773090 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:00:23.773502 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:00:23.782161 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:23.782644 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:23.783239 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:23.783968 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:23.784427 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:23.784847 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:23.802041 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Getting quotas for project 1a7f6c917c934c00a862b9946ce2b1cd. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:23.806060 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Getting quotas for user 1044cd9cbbe1497aae1939fe81f3f9a5 and project 1a7f6c917c934c00a862b9946ce2b1cd. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:23.816941 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:00:23.819899 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:00:23.866680 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5679bac0-510a-49ee-a8e5-62185d69cf93 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.972678 Sep 18 01:00:23.867452 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 289/579] 10.222.0.33 () {62 vars in 1188 bytes} [Sun Sep 18 01:00:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 18 01:00:23.880310 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ef1c7dc7-6b3f-4c52-8385-d0f7f388b8ba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:23.881214 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ef1c7dc7-6b3f-4c52-8385-d0f7f388b8ba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:23.935907 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ef1c7dc7-6b3f-4c52-8385-d0f7f388b8ba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:23.943974 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ef1c7dc7-6b3f-4c52-8385-d0f7f388b8ba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:23.945417 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ef1c7dc7-6b3f-4c52-8385-d0f7f388b8ba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:23.946564 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ef1c7dc7-6b3f-4c52-8385-d0f7f388b8ba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1281 microversion: 2.20 time: 0.071597 Sep 18 01:00:23.947354 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 291/580] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:23 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:00:24.972509 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:24.974172 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:24.981779 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:24.982260 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:24.982693 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:24.983420 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:24.983874 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:24.984327 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:25.060694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:25.070583 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:25.072280 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:25.073455 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-53b496c8-41b2-4d3b-beaa-94b2e0eb83ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1277 microversion: 2.20 time: 0.105349 Sep 18 01:00:25.077037 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 290/581] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:24 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:26.099386 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:26.099999 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:26.107450 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.108004 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.108523 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.109233 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.109691 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.110115 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.173532 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.182764 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.184315 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:26.185483 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d1825f13-d3fe-4baa-bcf1-f56f390b6405 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1339 microversion: 2.20 time: 0.090475 Sep 18 01:00:26.187253 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 292/582] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:26 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:26.383195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-70a8e0ad-36b6-4c1a-aef8-208ae214c00d req-6a8a4fd1-86e4-4bb4-bb58-50db297a46b8 admin admin] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:26.386745 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-70a8e0ad-36b6-4c1a-aef8-208ae214c00d req-6a8a4fd1-86e4-4bb4-bb58-50db297a46b8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.387335 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-70a8e0ad-36b6-4c1a-aef8-208ae214c00d req-6a8a4fd1-86e4-4bb4-bb58-50db297a46b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.387972 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-70a8e0ad-36b6-4c1a-aef8-208ae214c00d req-6a8a4fd1-86e4-4bb4-bb58-50db297a46b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.396793 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-70a8e0ad-36b6-4c1a-aef8-208ae214c00d req-6a8a4fd1-86e4-4bb4-bb58-50db297a46b8 admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:26.397271 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-70a8e0ad-36b6-4c1a-aef8-208ae214c00d req-6a8a4fd1-86e4-4bb4-bb58-50db297a46b8 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:26.397704 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-70a8e0ad-36b6-4c1a-aef8-208ae214c00d req-6a8a4fd1-86e4-4bb4-bb58-50db297a46b8 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:26.412596 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-70a8e0ad-36b6-4c1a-aef8-208ae214c00d req-6a8a4fd1-86e4-4bb4-bb58-50db297a46b8 admin admin] 10.222.0.57 "DELETE /compute/v2.1/os-assisted-volume-snapshots/d4d46bd3-dcaf-4f8d-828f-4dae17f393df?delete_info=%7B%22file_to_merge%22:%20%22volume-e1f87766-62a6-48bd-a5c9-9734a6c65bdf.d4d46bd3-dcaf-4f8d-828f-4dae17f393df.vhdx%22,%20%22volume_id%22:%20%22e1f87766-62a6-48bd-a5c9-9734a6c65bdf%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.081130 Sep 18 01:00:26.413189 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 291/583] 10.222.0.57 () {62 vars in 1800 bytes} [Sun Sep 18 01:00:26 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/d4d46bd3-dcaf-4f8d-828f-4dae17f393df?delete_info=%7B%22file_to_merge%22:%20%22volume-e1f87766-62a6-48bd-a5c9-9734a6c65bdf.d4d46bd3-dcaf-4f8d-828f-4dae17f393df.vhdx%22,%20%22volume_id%22:%20%22e1f87766-62a6-48bd-a5c9-9734a6c65bdf%22%7D => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:00:27.211210 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:27.211832 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:27.218203 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:27.218781 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:27.219255 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:27.219960 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:27.220422 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:27.220848 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:27.453799 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.462124 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.463632 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:27.464768 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-81b20615-ff46-47aa-b81c-03f33843ca50 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1407 microversion: 2.20 time: 0.257865 Sep 18 01:00:27.465506 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 293/584] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:27 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:27.930870 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-9908f5f8-1961-4260-b1a4-567dd3e60086 req-f2dffbcb-edf7-40f5-b3aa-43de0c30dab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f4bab30-d9b2-4713-ab65-46a4754f8153", "tag": "41948106-b5ee-425d-bfed-b11f6d5cdb7e"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:27.940510 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-9908f5f8-1961-4260-b1a4-567dd3e60086 req-f2dffbcb-edf7-40f5-b3aa-43de0c30dab3 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:27.940991 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-9908f5f8-1961-4260-b1a4-567dd3e60086 req-f2dffbcb-edf7-40f5-b3aa-43de0c30dab3 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:27.941420 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-9908f5f8-1961-4260-b1a4-567dd3e60086 req-f2dffbcb-edf7-40f5-b3aa-43de0c30dab3 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:27.954063 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-9908f5f8-1961-4260-b1a4-567dd3e60086 req-f2dffbcb-edf7-40f5-b3aa-43de0c30dab3 service nova] Creating event network-changed:41948106-b5ee-425d-bfed-b11f6d5cdb7e for instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 on hv-cinder-maste Sep 18 01:00:27.958857 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-9908f5f8-1961-4260-b1a4-567dd3e60086 req-f2dffbcb-edf7-40f5-b3aa-43de0c30dab3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033478 Sep 18 01:00:27.959334 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 292/585] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:00:28.491825 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:28.492468 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:28.499720 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:28.500210 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:28.500643 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.501345 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:28.501798 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:28.502221 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:28.659661 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:28.668488 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:28.669991 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:28.671126 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b1b4f263-8d72-4f73-b7e3-375fdff4fafe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1407 microversion: 2.20 time: 0.183721 Sep 18 01:00:28.671693 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 294/586] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:28 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:29.550396 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-f682b99f-2489-4e11-96d4-f7abefa2558a req-545c55f5-e7be-4ed1-a07c-2f7cc8d017f5 admin admin] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:29.554438 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-f682b99f-2489-4e11-96d4-f7abefa2558a req-545c55f5-e7be-4ed1-a07c-2f7cc8d017f5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.554941 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-f682b99f-2489-4e11-96d4-f7abefa2558a req-545c55f5-e7be-4ed1-a07c-2f7cc8d017f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.555389 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-f682b99f-2489-4e11-96d4-f7abefa2558a req-545c55f5-e7be-4ed1-a07c-2f7cc8d017f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.564735 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-f682b99f-2489-4e11-96d4-f7abefa2558a req-545c55f5-e7be-4ed1-a07c-2f7cc8d017f5 admin admin] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.565141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-f682b99f-2489-4e11-96d4-f7abefa2558a req-545c55f5-e7be-4ed1-a07c-2f7cc8d017f5 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.565563 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-f682b99f-2489-4e11-96d4-f7abefa2558a req-545c55f5-e7be-4ed1-a07c-2f7cc8d017f5 admin admin] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.578832 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-f682b99f-2489-4e11-96d4-f7abefa2558a req-545c55f5-e7be-4ed1-a07c-2f7cc8d017f5 admin admin] 10.222.0.57 "DELETE /compute/v2.1/os-assisted-volume-snapshots/54decb59-69a1-4eb9-a85a-878680a37578?delete_info=%7B%22file_to_merge%22:%20%22volume-e1f87766-62a6-48bd-a5c9-9734a6c65bdf.54decb59-69a1-4eb9-a85a-878680a37578.vhdx%22,%20%22volume_id%22:%20%22e1f87766-62a6-48bd-a5c9-9734a6c65bdf%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.078430 Sep 18 01:00:29.579398 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 293/587] 10.222.0.57 () {62 vars in 1800 bytes} [Sun Sep 18 01:00:29 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/54decb59-69a1-4eb9-a85a-878680a37578?delete_info=%7B%22file_to_merge%22:%20%22volume-e1f87766-62a6-48bd-a5c9-9734a6c65bdf.54decb59-69a1-4eb9-a85a-878680a37578.vhdx%22,%20%22volume_id%22:%20%22e1f87766-62a6-48bd-a5c9-9734a6c65bdf%22%7D => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:00:29.696628 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:29.697234 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:29.703652 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.704127 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.704555 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.705664 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:29.706124 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:29.706545 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:29.838657 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:29.846716 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:29.848945 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:29.850055 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0e9f14a4-ab26-4109-8d7d-61fd4837211c tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1407 microversion: 2.20 time: 0.157252 Sep 18 01:00:29.850617 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 295/588] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:29 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:00:30.876318 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:30.877023 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:30.884736 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.885227 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.885664 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:30.886368 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:30.886920 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:30.887354 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.015517 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:31.023923 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:31.025386 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:31.026499 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-ed3eb25b-8383-4360-a2a9-6d71fcd228d9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1407 microversion: 2.20 time: 0.154788 Sep 18 01:00:31.027088 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 294/589] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:30 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:31.086293 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-6ef13eae-f73b-47b4-ab2f-a8662389e6aa tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:31.088551 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6ef13eae-f73b-47b4-ab2f-a8662389e6aa tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:31.094978 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef13eae-f73b-47b4-ab2f-a8662389e6aa tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.095464 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef13eae-f73b-47b4-ab2f-a8662389e6aa tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.095905 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef13eae-f73b-47b4-ab2f-a8662389e6aa tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.096598 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef13eae-f73b-47b4-ab2f-a8662389e6aa tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.097055 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef13eae-f73b-47b4-ab2f-a8662389e6aa tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.097486 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6ef13eae-f73b-47b4-ab2f-a8662389e6aa tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.126963 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-6ef13eae-f73b-47b4-ab2f-a8662389e6aa tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044601 Sep 18 01:00:31.127523 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 296/590] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:00:31 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 18 01:00:31.191873 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-770fbde4-e3f5-4094-9c1b-3769e06c0f7f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:31.192454 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-770fbde4-e3f5-4094-9c1b-3769e06c0f7f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:31.198383 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-770fbde4-e3f5-4094-9c1b-3769e06c0f7f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.198907 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-770fbde4-e3f5-4094-9c1b-3769e06c0f7f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.199364 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-770fbde4-e3f5-4094-9c1b-3769e06c0f7f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.200035 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-770fbde4-e3f5-4094-9c1b-3769e06c0f7f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.200491 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-770fbde4-e3f5-4094-9c1b-3769e06c0f7f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.200915 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-770fbde4-e3f5-4094-9c1b-3769e06c0f7f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.226142 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-770fbde4-e3f5-4094-9c1b-3769e06c0f7f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Going to try to terminate instance {{(pid=120687) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:00:31.248170 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:31.308294 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-770fbde4-e3f5-4094-9c1b-3769e06c0f7f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 204 len: 0 microversion: 2.1 time: 0.120129 Sep 18 01:00:31.309013 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 295/591] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:00:31 2022] DELETE /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:00:31.317258 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d8ac5ecf-d6be-469b-82c8-fbabbd4142e1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:31.317873 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d8ac5ecf-d6be-469b-82c8-fbabbd4142e1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:31.324053 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8ac5ecf-d6be-469b-82c8-fbabbd4142e1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.324542 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8ac5ecf-d6be-469b-82c8-fbabbd4142e1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.324983 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8ac5ecf-d6be-469b-82c8-fbabbd4142e1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.325677 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8ac5ecf-d6be-469b-82c8-fbabbd4142e1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:31.326139 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8ac5ecf-d6be-469b-82c8-fbabbd4142e1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:31.326570 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8ac5ecf-d6be-469b-82c8-fbabbd4142e1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:31.456480 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d8ac5ecf-d6be-469b-82c8-fbabbd4142e1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:31.465473 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d8ac5ecf-d6be-469b-82c8-fbabbd4142e1 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1674 microversion: 2.1 time: 0.152133 Sep 18 01:00:31.466038 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 297/592] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:31 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:32.052453 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:32.053146 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:32.059649 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.060137 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.060581 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.061269 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.061729 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.062156 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.197163 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:32.205244 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:32.206675 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:32.207941 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-cacf5702-51b8-4e0f-8849-9d94e7841d9d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1407 microversion: 2.20 time: 0.159986 Sep 18 01:00:32.208508 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 296/593] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:32 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:32.489317 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f3d73503-bd66-4bbe-90ff-80411627f3e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:32.490090 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f3d73503-bd66-4bbe-90ff-80411627f3e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:32.496581 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3d73503-bd66-4bbe-90ff-80411627f3e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.497072 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3d73503-bd66-4bbe-90ff-80411627f3e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.497507 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3d73503-bd66-4bbe-90ff-80411627f3e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.498208 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3d73503-bd66-4bbe-90ff-80411627f3e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:32.498666 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3d73503-bd66-4bbe-90ff-80411627f3e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:32.499117 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3d73503-bd66-4bbe-90ff-80411627f3e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:32.629574 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f3d73503-bd66-4bbe-90ff-80411627f3e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:32.637563 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f3d73503-bd66-4bbe-90ff-80411627f3e4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1674 microversion: 2.1 time: 0.152611 Sep 18 01:00:32.638137 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 298/594] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:32 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:33.232665 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:33.233317 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:33.240000 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.240509 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.240956 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.241694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.242161 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.242594 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.373351 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:33.382398 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:33.383902 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:33.384995 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-34542c1c-ff41-44c2-ac8a-b6a9ab0a8db8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1407 microversion: 2.20 time: 0.156259 Sep 18 01:00:33.385565 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 297/595] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:33 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:33.661658 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fc838c3a-db11-4b7b-8ea2-6d8b6bf7f1ed tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:33.662267 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-fc838c3a-db11-4b7b-8ea2-6d8b6bf7f1ed tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:33.664252 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=4 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:33.670318 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fc838c3a-db11-4b7b-8ea2-6d8b6bf7f1ed tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.670828 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fc838c3a-db11-4b7b-8ea2-6d8b6bf7f1ed tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.671272 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fc838c3a-db11-4b7b-8ea2-6d8b6bf7f1ed tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.671974 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fc838c3a-db11-4b7b-8ea2-6d8b6bf7f1ed tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.672439 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fc838c3a-db11-4b7b-8ea2-6d8b6bf7f1ed tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.672864 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fc838c3a-db11-4b7b-8ea2-6d8b6bf7f1ed tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.808696 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-fc838c3a-db11-4b7b-8ea2-6d8b6bf7f1ed tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:33.817217 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-fc838c3a-db11-4b7b-8ea2-6d8b6bf7f1ed tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1674 microversion: 2.1 time: 0.159475 Sep 18 01:00:33.817804 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 299/596] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:33 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:33.845934 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-f0654957-9e14-44fe-b13e-602f9f901ce3 req-4b84b67a-6f06-4107-b0d9-729f1f21ae38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f4bab30-d9b2-4713-ab65-46a4754f8153", "name": "network-vif-plugged", "status": "completed", "tag": "41948106-b5ee-425d-bfed-b11f6d5cdb7e"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:33.851148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=10 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:33.858115 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-f0654957-9e14-44fe-b13e-602f9f901ce3 req-4b84b67a-6f06-4107-b0d9-729f1f21ae38 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:33.859089 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-f0654957-9e14-44fe-b13e-602f9f901ce3 req-4b84b67a-6f06-4107-b0d9-729f1f21ae38 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:33.859524 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-f0654957-9e14-44fe-b13e-602f9f901ce3 req-4b84b67a-6f06-4107-b0d9-729f1f21ae38 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:33.874200 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-f0654957-9e14-44fe-b13e-602f9f901ce3 req-4b84b67a-6f06-4107-b0d9-729f1f21ae38 service nova] Creating event network-vif-plugged:41948106-b5ee-425d-bfed-b11f6d5cdb7e for instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 on hv-cinder-maste Sep 18 01:00:33.879444 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-f0654957-9e14-44fe-b13e-602f9f901ce3 req-4b84b67a-6f06-4107-b0d9-729f1f21ae38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037178 Sep 18 01:00:33.880050 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 298/597] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:34.410083 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:34.410700 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:34.412557 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:34.418056 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.418546 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.419016 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.419715 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.420171 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.420597 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.588166 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:34.596498 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:34.598327 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:34.599470 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f19e4e5a-6a45-4ec1-8de4-e7a8901036ec tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1407 microversion: 2.20 time: 0.193292 Sep 18 01:00:34.600038 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 300/598] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:34 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:34.841246 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-497b1a23-f301-4fcc-8095-f27813f1f93c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:34.841979 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-497b1a23-f301-4fcc-8095-f27813f1f93c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:34.853285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-497b1a23-f301-4fcc-8095-f27813f1f93c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.853791 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-497b1a23-f301-4fcc-8095-f27813f1f93c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.854234 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-497b1a23-f301-4fcc-8095-f27813f1f93c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:34.854995 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-497b1a23-f301-4fcc-8095-f27813f1f93c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:34.855484 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-497b1a23-f301-4fcc-8095-f27813f1f93c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:34.855907 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-497b1a23-f301-4fcc-8095-f27813f1f93c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.085402 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-497b1a23-f301-4fcc-8095-f27813f1f93c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.093335 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-497b1a23-f301-4fcc-8095-f27813f1f93c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1674 microversion: 2.1 time: 0.256388 Sep 18 01:00:35.093855 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 299/599] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:34 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1674 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:35.464666 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-fbb06732-cb74-46fe-a99e-e41258779d29 req-57dbe697-c349-46b4-b394-68fd3e808a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf6631e-213a-40ea-8708-5dc51da0ee8c", "name": "network-vif-deleted", "tag": "caeb66db-fb12-4f3e-b68c-119f4575bc44"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:35.474508 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-fbb06732-cb74-46fe-a99e-e41258779d29 req-57dbe697-c349-46b4-b394-68fd3e808a22 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.475025 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-fbb06732-cb74-46fe-a99e-e41258779d29 req-57dbe697-c349-46b4-b394-68fd3e808a22 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.475467 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-fbb06732-cb74-46fe-a99e-e41258779d29 req-57dbe697-c349-46b4-b394-68fd3e808a22 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.486858 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-fbb06732-cb74-46fe-a99e-e41258779d29 req-57dbe697-c349-46b4-b394-68fd3e808a22 service nova] Creating event network-vif-deleted:caeb66db-fb12-4f3e-b68c-119f4575bc44 for instance abf6631e-213a-40ea-8708-5dc51da0ee8c on hv-cinder-maste Sep 18 01:00:35.492528 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-fbb06732-cb74-46fe-a99e-e41258779d29 req-57dbe697-c349-46b4-b394-68fd3e808a22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031722 Sep 18 01:00:35.493123 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 301/600] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:35.604051 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-103f785b-e9c3-4978-b5b7-c1c92282e1bc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:35.604574 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-103f785b-e9c3-4978-b5b7-c1c92282e1bc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:35.622615 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-103f785b-e9c3-4978-b5b7-c1c92282e1bc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.623212 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-103f785b-e9c3-4978-b5b7-c1c92282e1bc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.623649 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-103f785b-e9c3-4978-b5b7-c1c92282e1bc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.625953 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-103f785b-e9c3-4978-b5b7-c1c92282e1bc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.626658 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-103f785b-e9c3-4978-b5b7-c1c92282e1bc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.627394 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-103f785b-e9c3-4978-b5b7-c1c92282e1bc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.629702 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:35.630734 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:35.639853 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.640750 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.641450 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.642553 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:35.643333 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:35.643985 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:35.757741 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-103f785b-e9c3-4978-b5b7-c1c92282e1bc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lazy-loading 'services' on Instance uuid def988da-b233-4deb-b329-656813dfed41 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:35.798072 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.807555 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.809152 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:35.811450 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d16c9c39-ab0b-42d7-bf60-7cf0a9b6d52d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1407 microversion: 2.20 time: 0.188209 Sep 18 01:00:35.812663 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 302/601] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:35 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:35.852014 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-103f785b-e9c3-4978-b5b7-c1c92282e1bc tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "DELETE /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41/os-volume_attachments/e1f87766-62a6-48bd-a5c9-9734a6c65bdf" status: 202 len: 0 microversion: 2.1 time: 0.261463 Sep 18 01:00:35.855921 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 300/602] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 01:00:35 2022] DELETE /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41/os-volume_attachments/e1f87766-62a6-48bd-a5c9-9734a6c65bdf => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:00:36.124095 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:36.128258 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:36.136257 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.137126 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.137771 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:36.138508 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.138988 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.139412 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:36.158981 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=100 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:36.174011 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.174657 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.175746 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:36.176426 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lazy-loading 'fault' on Instance uuid abf6631e-213a-40ea-8708-5dc51da0ee8c {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:36.222678 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:36.230464 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-632f786e-bbfb-4cb8-94c7-6b278a26177e tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1326 microversion: 2.1 time: 0.110435 Sep 18 01:00:36.231130 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 303/603] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:36 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1326 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:36.837918 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:36.839047 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:36.845647 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.846132 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.846564 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:36.847905 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:36.848884 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:36.849280 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.005731 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:37.013899 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:37.015382 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:37.016559 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0684b92e-c9ec-43e6-990e-e714ce84ddbf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1600 microversion: 2.20 time: 0.182864 Sep 18 01:00:37.017120 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 301/604] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:00:36 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1600 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:00:37.041709 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-eb359319-77cd-4fb8-bc3e-17bcf8feeaae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:37.042207 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-eb359319-77cd-4fb8-bc3e-17bcf8feeaae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:37.044491 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=76 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:37.049975 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb359319-77cd-4fb8-bc3e-17bcf8feeaae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.050503 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb359319-77cd-4fb8-bc3e-17bcf8feeaae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.050984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb359319-77cd-4fb8-bc3e-17bcf8feeaae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.051715 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb359319-77cd-4fb8-bc3e-17bcf8feeaae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.052175 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb359319-77cd-4fb8-bc3e-17bcf8feeaae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.052605 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb359319-77cd-4fb8-bc3e-17bcf8feeaae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.127652 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-eb359319-77cd-4fb8-bc3e-17bcf8feeaae tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089751 Sep 18 01:00:37.128772 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 304/605] 10.222.0.33 () {60 vars in 1316 bytes} [Sun Sep 18 01:00:37 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:00:37.255612 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:37.256229 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:37.262519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.263160 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.263717 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.264522 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.265083 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.265602 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.303382 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:37.303868 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:37.304618 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:37.305292 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lazy-loading 'fault' on Instance uuid abf6631e-213a-40ea-8708-5dc51da0ee8c {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:37.381740 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:37.389583 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-25df00df-f73d-4a97-9b12-5c34bcc36ba9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 200 len: 1326 microversion: 2.1 time: 0.138244 Sep 18 01:00:37.390161 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 302/606] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:37 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 1326 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:38.071861 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-75e94788-52e2-40e9-ab80-e877bedbfacb tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:38.072466 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-75e94788-52e2-40e9-ab80-e877bedbfacb tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:38.078333 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-75e94788-52e2-40e9-ab80-e877bedbfacb tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.079102 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-75e94788-52e2-40e9-ab80-e877bedbfacb tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.079274 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-75e94788-52e2-40e9-ab80-e877bedbfacb tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.079956 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-75e94788-52e2-40e9-ab80-e877bedbfacb tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.080409 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-75e94788-52e2-40e9-ab80-e877bedbfacb tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.080830 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-75e94788-52e2-40e9-ab80-e877bedbfacb tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.106824 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-75e94788-52e2-40e9-ab80-e877bedbfacb tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Going to try to terminate instance {{(pid=120686) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:00:38.183018 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-75e94788-52e2-40e9-ab80-e877bedbfacb tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "DELETE /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 204 len: 0 microversion: 2.1 time: 0.115377 Sep 18 01:00:38.183816 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 305/607] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:00:38 2022] DELETE /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:00:38.192873 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-67bfef37-e5c2-40b3-9b10-c86f73d3aa06 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:38.193670 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-67bfef37-e5c2-40b3-9b10-c86f73d3aa06 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:38.199972 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67bfef37-e5c2-40b3-9b10-c86f73d3aa06 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.200537 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67bfef37-e5c2-40b3-9b10-c86f73d3aa06 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.201054 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67bfef37-e5c2-40b3-9b10-c86f73d3aa06 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.201820 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67bfef37-e5c2-40b3-9b10-c86f73d3aa06 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.202373 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67bfef37-e5c2-40b3-9b10-c86f73d3aa06 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.202896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-67bfef37-e5c2-40b3-9b10-c86f73d3aa06 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.413725 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:38.414689 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:38.420594 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.421080 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.421716 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.422420 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.422903 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.423332 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.428577 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-67bfef37-e5c2-40b3-9b10-c86f73d3aa06 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:38.437161 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-67bfef37-e5c2-40b3-9b10-c86f73d3aa06 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1515 microversion: 2.1 time: 0.248791 Sep 18 01:00:38.437750 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 303/608] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:38 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1515 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:38.443293 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] HTTP exception thrown: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Request method failure captured: Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c HTTP/1.1 Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmynEdNL7pAf1LovTldThupAVrePdjpWMxOnZKz4r-6pbCS15yBIvLlIATJ4grvojw4g5Raldgq6JL_4BlZSX21FYvBVnO9YPAVAttzmSKR5FH7h-tEAEcnxtuF-yTXEZYmZzhDe4A2PDTjtn66SZzhOc4zmSwuEzFRV0iiUIus1qgU Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:00:38.443414 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a60d2801df884e15be8a0464cb725d6d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}] Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 5e49a94877574c58aa4ff068b69a3dd6 Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:00:38.445037 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'abf6631e-213a-40ea-8708-5dc51da0ee8c'} Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:38.445880 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:00:38.447209 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:38.448544 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Returning 404 to user: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:38.448544 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d612e9c1-43c6-4f8b-9972-6a67e1e3c58f tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 404 len: 111 microversion: 2.1 time: 0.035948 Sep 18 01:00:38.448544 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 306/609] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:38 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:00:38.451280 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-72f4402e-e80e-4ec7-9916-b6f0897cb55f req-7a440fc2-c393-4ead-ab5c-93985700a6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f4bab30-d9b2-4713-ab65-46a4754f8153", "tag": "41948106-b5ee-425d-bfed-b11f6d5cdb7e"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:38.454444 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8ec9115b-6290-4bc1-a2b5-684c9014afb8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '.version_select at 0x7f5672a14c10>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:38.460902 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-72f4402e-e80e-4ec7-9916-b6f0897cb55f req-7a440fc2-c393-4ead-ab5c-93985700a6ef service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:38.461669 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-72f4402e-e80e-4ec7-9916-b6f0897cb55f req-7a440fc2-c393-4ead-ab5c-93985700a6ef service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:38.462162 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-72f4402e-e80e-4ec7-9916-b6f0897cb55f req-7a440fc2-c393-4ead-ab5c-93985700a6ef service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:38.474919 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8ec9115b-6290-4bc1-a2b5-684c9014afb8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-917426502" status: 202 len: 0 microversion: 2.1 time: 0.024476 Sep 18 01:00:38.478914 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 304/610] 10.222.0.33 () {58 vars in 1218 bytes} [Sun Sep 18 01:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-917426502 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:00:38.479047 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-72f4402e-e80e-4ec7-9916-b6f0897cb55f req-7a440fc2-c393-4ead-ab5c-93985700a6ef service nova] Creating event network-changed:41948106-b5ee-425d-bfed-b11f6d5cdb7e for instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 on hv-cinder-maste Sep 18 01:00:38.481815 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-72f4402e-e80e-4ec7-9916-b6f0897cb55f req-7a440fc2-c393-4ead-ab5c-93985700a6ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035156 Sep 18 01:00:38.482654 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 307/611] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:39.147652 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1e4506d7-01ca-49bd-9dac-ae1877b9b156 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Action: 'create', calling method: .version_select at 0x7f5672bf18b0>, body: {"keypair": {"name": "tempest-keypair-1131484346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD50QLDCNwq08UtxMa0xb7UAT6qIAIGqFJIsL7JMndkxibunyUJjDRbDVBL1zzlL1brb9Z9Lcl1BbLyutbCVdLM/WynzmqJO6LdccRcpx1HmRXgAN+Y2l6eRFmZqmYp9bQ=="}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:39.163836 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-1e4506d7-01ca-49bd-9dac-ae1877b9b156 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Getting quotas for project a60d2801df884e15be8a0464cb725d6d. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:39.167786 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-1e4506d7-01ca-49bd-9dac-ae1877b9b156 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Getting quotas for user 5e49a94877574c58aa4ff068b69a3dd6 and project a60d2801df884e15be8a0464cb725d6d. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:39.191483 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1e4506d7-01ca-49bd-9dac-ae1877b9b156 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048519 Sep 18 01:00:39.192100 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 305/612] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 18 01:00:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:39.470169 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-45d682c8-339a-4efb-9a63-8241469dcc7c tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:39.471010 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-45d682c8-339a-4efb-9a63-8241469dcc7c tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:39.479066 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45d682c8-339a-4efb-9a63-8241469dcc7c tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:39.479562 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45d682c8-339a-4efb-9a63-8241469dcc7c tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:39.480475 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45d682c8-339a-4efb-9a63-8241469dcc7c tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:39.481219 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45d682c8-339a-4efb-9a63-8241469dcc7c tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:39.481865 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45d682c8-339a-4efb-9a63-8241469dcc7c tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:39.482295 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45d682c8-339a-4efb-9a63-8241469dcc7c tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:39.677548 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-45d682c8-339a-4efb-9a63-8241469dcc7c tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:39.685605 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-45d682c8-339a-4efb-9a63-8241469dcc7c tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1515 microversion: 2.1 time: 0.228988 Sep 18 01:00:39.686319 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 308/613] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:39 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1515 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:40.540075 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=8 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:40.544740 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-93715230", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e60962c-164c-4e15-8d69-6601f5d7b205"}], "security_groups": [{"name": "tempest-securitygroup--2061960217"}], "key_name": "tempest-keypair-1131484346", "user_data": "}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:40.646941 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] validate_networks() for [('3e60962c-164c-4e15-8d69-6601f5d7b205', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:00:40.709136 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-60095b97-b3d3-40b4-b385-ca6a94cfe811 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:40.709693 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-60095b97-b3d3-40b4-b385-ca6a94cfe811 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:40.716158 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60095b97-b3d3-40b4-b385-ca6a94cfe811 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:40.716636 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60095b97-b3d3-40b4-b385-ca6a94cfe811 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:40.717066 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60095b97-b3d3-40b4-b385-ca6a94cfe811 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:40.717753 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60095b97-b3d3-40b4-b385-ca6a94cfe811 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:40.718204 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60095b97-b3d3-40b4-b385-ca6a94cfe811 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:40.718622 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-60095b97-b3d3-40b4-b385-ca6a94cfe811 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:40.917659 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-60095b97-b3d3-40b4-b385-ca6a94cfe811 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:40.925306 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-60095b97-b3d3-40b4-b385-ca6a94cfe811 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1515 microversion: 2.1 time: 0.220978 Sep 18 01:00:40.925879 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 309/614] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:40 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:00:41.072570 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:00:41.073000 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:00:41.073482 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:00:41.073930 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:00:41.074478 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:00:41.084004 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.084497 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.084937 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.085676 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.086141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.086573 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.103668 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Getting quotas for project a60d2801df884e15be8a0464cb725d6d. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:00:41.107643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Getting quotas for user 5e49a94877574c58aa4ff068b69a3dd6 and project a60d2801df884e15be8a0464cb725d6d. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:00:41.119360 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:00:41.121900 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:00:41.168583 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a1a81507-c17c-471f-82c1-0d7b20592046 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.629658 Sep 18 01:00:41.169273 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 306/615] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 01:00:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:00:41.180791 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-5a3bf3f8-e630-407b-8dae-e79d6a9f144c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:41.181440 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-5a3bf3f8-e630-407b-8dae-e79d6a9f144c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:41.235625 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-5a3bf3f8-e630-407b-8dae-e79d6a9f144c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:41.242426 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-5a3bf3f8-e630-407b-8dae-e79d6a9f144c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1236 microversion: 2.1 time: 0.065682 Sep 18 01:00:41.243423 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 310/616] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:41 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:41.948632 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-fb233ed1-4f81-4408-a788-2e94858ec8cf tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:41.949252 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-fb233ed1-4f81-4408-a788-2e94858ec8cf tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:41.958916 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fb233ed1-4f81-4408-a788-2e94858ec8cf tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.959404 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fb233ed1-4f81-4408-a788-2e94858ec8cf tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.959839 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fb233ed1-4f81-4408-a788-2e94858ec8cf tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:41.960535 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fb233ed1-4f81-4408-a788-2e94858ec8cf tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:41.960999 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fb233ed1-4f81-4408-a788-2e94858ec8cf tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:41.962921 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fb233ed1-4f81-4408-a788-2e94858ec8cf tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.088241 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-fb233ed1-4f81-4408-a788-2e94858ec8cf tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:42.095928 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-fb233ed1-4f81-4408-a788-2e94858ec8cf tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1515 microversion: 2.1 time: 0.151230 Sep 18 01:00:42.096498 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 307/617] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:41 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:42.264651 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-32ccf9f8-9c45-4de9-b3f3-ed5aa892e2b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:42.265194 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-32ccf9f8-9c45-4de9-b3f3-ed5aa892e2b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:42.272333 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-32ccf9f8-9c45-4de9-b3f3-ed5aa892e2b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:42.272814 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-32ccf9f8-9c45-4de9-b3f3-ed5aa892e2b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:42.273247 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-32ccf9f8-9c45-4de9-b3f3-ed5aa892e2b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.273933 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-32ccf9f8-9c45-4de9-b3f3-ed5aa892e2b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:42.274386 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-32ccf9f8-9c45-4de9-b3f3-ed5aa892e2b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:42.274824 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-32ccf9f8-9c45-4de9-b3f3-ed5aa892e2b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:42.338616 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-32ccf9f8-9c45-4de9-b3f3-ed5aa892e2b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:42.346293 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-32ccf9f8-9c45-4de9-b3f3-ed5aa892e2b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1240 microversion: 2.1 time: 0.085577 Sep 18 01:00:42.346871 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 311/618] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:42 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:43.119441 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-fe01fe9c-7015-4989-bb18-a9c047d30302 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:43.120055 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-fe01fe9c-7015-4989-bb18-a9c047d30302 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:43.126945 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe01fe9c-7015-4989-bb18-a9c047d30302 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.127444 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe01fe9c-7015-4989-bb18-a9c047d30302 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.127882 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe01fe9c-7015-4989-bb18-a9c047d30302 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.128580 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe01fe9c-7015-4989-bb18-a9c047d30302 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.129237 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe01fe9c-7015-4989-bb18-a9c047d30302 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.129723 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fe01fe9c-7015-4989-bb18-a9c047d30302 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.261545 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-fe01fe9c-7015-4989-bb18-a9c047d30302 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:43.272908 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-fe01fe9c-7015-4989-bb18-a9c047d30302 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1515 microversion: 2.1 time: 0.157307 Sep 18 01:00:43.273899 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 308/619] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:43 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:43.370547 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c2c42be7-ecf2-4435-a655-28b1b1bf1745 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:43.371177 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c2c42be7-ecf2-4435-a655-28b1b1bf1745 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:43.377542 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2c42be7-ecf2-4435-a655-28b1b1bf1745 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.378020 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2c42be7-ecf2-4435-a655-28b1b1bf1745 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.378446 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2c42be7-ecf2-4435-a655-28b1b1bf1745 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.379381 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2c42be7-ecf2-4435-a655-28b1b1bf1745 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.379988 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2c42be7-ecf2-4435-a655-28b1b1bf1745 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.380573 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c2c42be7-ecf2-4435-a655-28b1b1bf1745 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.440687 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c2c42be7-ecf2-4435-a655-28b1b1bf1745 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:43.448847 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c2c42be7-ecf2-4435-a655-28b1b1bf1745 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1232 microversion: 2.1 time: 0.082325 Sep 18 01:00:43.456610 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 312/620] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:43 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1232 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:43.959152 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-ed5eecb9-db2d-44f6-84cc-25ba8bdb0efd req-f2bec7b2-4c53-46f0-8881-cde40d033bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def988da-b233-4deb-b329-656813dfed41", "name": "network-vif-deleted", "tag": "1239cb20-24bd-4543-8342-b66e69ae21eb"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:43.968767 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ed5eecb9-db2d-44f6-84cc-25ba8bdb0efd req-f2bec7b2-4c53-46f0-8881-cde40d033bad service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:43.969256 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ed5eecb9-db2d-44f6-84cc-25ba8bdb0efd req-f2bec7b2-4c53-46f0-8881-cde40d033bad service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:43.969688 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ed5eecb9-db2d-44f6-84cc-25ba8bdb0efd req-f2bec7b2-4c53-46f0-8881-cde40d033bad service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:43.981438 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-ed5eecb9-db2d-44f6-84cc-25ba8bdb0efd req-f2bec7b2-4c53-46f0-8881-cde40d033bad service nova] Creating event network-vif-deleted:1239cb20-24bd-4543-8342-b66e69ae21eb for instance def988da-b233-4deb-b329-656813dfed41 on hv-cinder-maste Sep 18 01:00:43.986446 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-ed5eecb9-db2d-44f6-84cc-25ba8bdb0efd req-f2bec7b2-4c53-46f0-8881-cde40d033bad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031817 Sep 18 01:00:43.987075 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 309/621] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:44.297523 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:44.298168 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:44.304779 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.305368 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.305894 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.306608 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.307221 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.307656 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.338814 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.339306 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.339740 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.340183 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lazy-loading 'fault' on Instance uuid def988da-b233-4deb-b329-656813dfed41 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:44.411476 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23f9e763a994566bddd9508a79cce54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5eba1f622574f5cacecaccdba833801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:44.422233 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-425bc88a-8fc1-4bef-ba3b-29defe2ec702 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 200 len: 1309 microversion: 2.1 time: 0.129347 Sep 18 01:00:44.424588 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 313/622] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:44 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:44.474464 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a639add0-3495-4778-8a1a-8c1a0fadb88d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:44.475195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a639add0-3495-4778-8a1a-8c1a0fadb88d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:44.482407 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a639add0-3495-4778-8a1a-8c1a0fadb88d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.483014 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a639add0-3495-4778-8a1a-8c1a0fadb88d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.483643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a639add0-3495-4778-8a1a-8c1a0fadb88d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.484513 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a639add0-3495-4778-8a1a-8c1a0fadb88d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:44.485137 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a639add0-3495-4778-8a1a-8c1a0fadb88d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:44.485743 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a639add0-3495-4778-8a1a-8c1a0fadb88d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:44.562672 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a639add0-3495-4778-8a1a-8c1a0fadb88d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:44.570835 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a639add0-3495-4778-8a1a-8c1a0fadb88d tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1294 microversion: 2.1 time: 0.101876 Sep 18 01:00:44.571707 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 310/623] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:44 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:45.448206 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:45.448762 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] [instance: def988da-b233-4deb-b329-656813dfed41] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:45.455277 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.455767 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.456198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.456917 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.457376 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.457806 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.471620 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] HTTP exception thrown: Instance def988da-b233-4deb-b329-656813dfed41 could not be found. Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Request method failure captured: Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 HTTP/1.1 Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJm0nf-3wPnDccIqgqPwkBEpX8SyUu6hRxMKNSU_2bZ_J4hJVSMnQET7iyQy3TQBk3c-Dpbt6fJlCrYQDYJ9VhLWjZr2p22zFarziY8ZK2HgB_cAPG_r-eJFNMuhrY6tciBIsNqpHEm4fYEsxMmjc8-4pF-AkK9smyy1_f-F9NfyoWMI Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: a5eba1f622574f5cacecaccdba833801 Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-VolumesSnapshotTestJSON-698728750 Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:00:45.473778 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a5eba1f622574f5cacecaccdba833801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a5eba1f622574f5cacecaccdba833801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a5eba1f622574f5cacecaccdba833801", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a5eba1f622574f5cacecaccdba833801"}]}] Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-VolumesSnapshotTestJSON-698728750 Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: a5eba1f622574f5cacecaccdba833801 Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-698728750 Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-VolumesSnapshotTestJSON-698728750-project Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: d23f9e763a994566bddd9508a79cce54 Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-VolumesSnapshotTestJSON-698728750-project Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance def988da-b233-4deb-b329-656813dfed41 could not be found. Sep 18 01:00:45.475370 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'def988da-b233-4deb-b329-656813dfed41'} Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def988da-b233-4deb-b329-656813dfed41 could not be found. Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:45.476167 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def988da-b233-4deb-b329-656813dfed41 could not be found. Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def988da-b233-4deb-b329-656813dfed41 could not be found. Sep 18 01:00:45.477321 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:45.478370 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] Returning 404 to user: Instance def988da-b233-4deb-b329-656813dfed41 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:45.478370 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f177ab91-e590-425b-a5c8-0c52c7417f63 tempest-VolumesSnapshotTestJSON-698728750 tempest-VolumesSnapshotTestJSON-698728750-project] 10.222.0.33 "GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41" status: 404 len: 111 microversion: 2.1 time: 0.031347 Sep 18 01:00:45.478370 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 314/624] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:45 2022] GET /compute/v2.1/servers/def988da-b233-4deb-b329-656813dfed41 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:00:45.594229 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a4d65811-0338-4d6d-b1d0-58fb699cfded tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:45.595412 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a4d65811-0338-4d6d-b1d0-58fb699cfded tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:45.602467 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4d65811-0338-4d6d-b1d0-58fb699cfded tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.603242 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4d65811-0338-4d6d-b1d0-58fb699cfded tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.603677 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4d65811-0338-4d6d-b1d0-58fb699cfded tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:45.604759 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4d65811-0338-4d6d-b1d0-58fb699cfded tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:45.605462 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4d65811-0338-4d6d-b1d0-58fb699cfded tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:45.605852 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4d65811-0338-4d6d-b1d0-58fb699cfded tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:46.076367 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a4d65811-0338-4d6d-b1d0-58fb699cfded tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:46.084895 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a4d65811-0338-4d6d-b1d0-58fb699cfded tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1362 microversion: 2.1 time: 0.494929 Sep 18 01:00:46.085460 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 311/625] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:45 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1362 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:46.230226 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-44f0004e-fa90-433e-b5ec-7e7931bac42f req-b60d274c-fb5f-4d20-9f5e-b1f3b45f206f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b63a4a6-ced3-44e7-ba27-44875b4943f4", "tag": "e361fc39-aed8-424c-893a-c016b77dcdc2"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:46.241014 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-44f0004e-fa90-433e-b5ec-7e7931bac42f req-b60d274c-fb5f-4d20-9f5e-b1f3b45f206f service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:46.241475 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-44f0004e-fa90-433e-b5ec-7e7931bac42f req-b60d274c-fb5f-4d20-9f5e-b1f3b45f206f service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:46.242160 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-44f0004e-fa90-433e-b5ec-7e7931bac42f req-b60d274c-fb5f-4d20-9f5e-b1f3b45f206f service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:46.254305 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-44f0004e-fa90-433e-b5ec-7e7931bac42f req-b60d274c-fb5f-4d20-9f5e-b1f3b45f206f service nova] Creating event network-changed:e361fc39-aed8-424c-893a-c016b77dcdc2 for instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 on hv-cinder-maste Sep 18 01:00:46.259675 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-44f0004e-fa90-433e-b5ec-7e7931bac42f req-b60d274c-fb5f-4d20-9f5e-b1f3b45f206f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032764 Sep 18 01:00:46.260352 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 315/626] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:47.108215 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-04f432b0-3b88-4eab-8350-1d044a6937dc tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:47.109072 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-04f432b0-3b88-4eab-8350-1d044a6937dc tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:47.116856 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04f432b0-3b88-4eab-8350-1d044a6937dc tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.117421 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04f432b0-3b88-4eab-8350-1d044a6937dc tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.118090 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04f432b0-3b88-4eab-8350-1d044a6937dc tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.118980 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04f432b0-3b88-4eab-8350-1d044a6937dc tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:47.119444 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04f432b0-3b88-4eab-8350-1d044a6937dc tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:47.119869 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-04f432b0-3b88-4eab-8350-1d044a6937dc tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:47.257337 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-04f432b0-3b88-4eab-8350-1d044a6937dc tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:47.266502 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-04f432b0-3b88-4eab-8350-1d044a6937dc tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1362 microversion: 2.1 time: 0.162670 Sep 18 01:00:47.267207 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 312/627] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:47 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:48.297834 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7f7e3bfb-f18f-48ae-bb9a-3723657983f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:48.298560 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7f7e3bfb-f18f-48ae-bb9a-3723657983f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:48.306632 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f7e3bfb-f18f-48ae-bb9a-3723657983f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.307155 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f7e3bfb-f18f-48ae-bb9a-3723657983f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.307598 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f7e3bfb-f18f-48ae-bb9a-3723657983f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.308306 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f7e3bfb-f18f-48ae-bb9a-3723657983f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:48.308767 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f7e3bfb-f18f-48ae-bb9a-3723657983f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:48.309597 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7f7e3bfb-f18f-48ae-bb9a-3723657983f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:48.451384 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7f7e3bfb-f18f-48ae-bb9a-3723657983f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:48.460257 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7f7e3bfb-f18f-48ae-bb9a-3723657983f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1362 microversion: 2.1 time: 0.166613 Sep 18 01:00:48.460820 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 316/628] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:48 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:49.482513 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-df72cc09-c0c8-4090-b546-291f8ab7b18a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:49.483147 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-df72cc09-c0c8-4090-b546-291f8ab7b18a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:49.486612 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:49.492035 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-df72cc09-c0c8-4090-b546-291f8ab7b18a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:49.492517 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-df72cc09-c0c8-4090-b546-291f8ab7b18a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:49.492952 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-df72cc09-c0c8-4090-b546-291f8ab7b18a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:49.493644 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-df72cc09-c0c8-4090-b546-291f8ab7b18a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:49.494099 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-df72cc09-c0c8-4090-b546-291f8ab7b18a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:49.494517 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-df72cc09-c0c8-4090-b546-291f8ab7b18a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:49.637233 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-df72cc09-c0c8-4090-b546-291f8ab7b18a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:49.645642 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-df72cc09-c0c8-4090-b546-291f8ab7b18a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1362 microversion: 2.1 time: 0.166915 Sep 18 01:00:49.646208 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 313/629] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:49 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:50.677353 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f4b8bb1c-2f62-41df-9c1c-56b8953b91d3 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:50.677962 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f4b8bb1c-2f62-41df-9c1c-56b8953b91d3 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:50.684597 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb1c-2f62-41df-9c1c-56b8953b91d3 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:50.685094 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb1c-2f62-41df-9c1c-56b8953b91d3 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:50.685529 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb1c-2f62-41df-9c1c-56b8953b91d3 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:50.686326 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb1c-2f62-41df-9c1c-56b8953b91d3 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:50.686811 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb1c-2f62-41df-9c1c-56b8953b91d3 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:50.687402 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb1c-2f62-41df-9c1c-56b8953b91d3 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:50.823446 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f4b8bb1c-2f62-41df-9c1c-56b8953b91d3 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:50.831398 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f4b8bb1c-2f62-41df-9c1c-56b8953b91d3 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1362 microversion: 2.1 time: 0.157766 Sep 18 01:00:50.842840 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 317/630] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:50 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:51.854719 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8cb6c5d6-e081-4cd5-8c23-65a1f11d67e8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:51.855511 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8cb6c5d6-e081-4cd5-8c23-65a1f11d67e8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:51.859050 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:51.859695 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=10 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:51.864508 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cb6c5d6-e081-4cd5-8c23-65a1f11d67e8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:51.865007 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cb6c5d6-e081-4cd5-8c23-65a1f11d67e8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:51.865442 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cb6c5d6-e081-4cd5-8c23-65a1f11d67e8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:51.867932 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cb6c5d6-e081-4cd5-8c23-65a1f11d67e8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:51.868406 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cb6c5d6-e081-4cd5-8c23-65a1f11d67e8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:51.868852 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cb6c5d6-e081-4cd5-8c23-65a1f11d67e8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:51.874533 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:51.936124 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-67d73a50-9e06-4470-9d3e-ec0dd570d9b5 req-a11b6817-014d-46d3-a014-7452e9689be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b63a4a6-ced3-44e7-ba27-44875b4943f4", "name": "network-vif-plugged", "status": "completed", "tag": "e361fc39-aed8-424c-893a-c016b77dcdc2"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:51.946077 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:51.952806 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-67d73a50-9e06-4470-9d3e-ec0dd570d9b5 req-a11b6817-014d-46d3-a014-7452e9689be1 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:51.953290 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-67d73a50-9e06-4470-9d3e-ec0dd570d9b5 req-a11b6817-014d-46d3-a014-7452e9689be1 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:51.953714 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-67d73a50-9e06-4470-9d3e-ec0dd570d9b5 req-a11b6817-014d-46d3-a014-7452e9689be1 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:51.972705 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-67d73a50-9e06-4470-9d3e-ec0dd570d9b5 req-a11b6817-014d-46d3-a014-7452e9689be1 service nova] Creating event network-vif-plugged:e361fc39-aed8-424c-893a-c016b77dcdc2 for instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 on hv-cinder-maste Sep 18 01:00:51.992599 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-67d73a50-9e06-4470-9d3e-ec0dd570d9b5 req-a11b6817-014d-46d3-a014-7452e9689be1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060364 Sep 18 01:00:51.993486 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 318/631] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:52.059665 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8cb6c5d6-e081-4cd5-8c23-65a1f11d67e8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:52.071182 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8cb6c5d6-e081-4cd5-8c23-65a1f11d67e8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1362 microversion: 2.1 time: 0.220302 Sep 18 01:00:52.072115 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 314/632] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:51 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:53.095597 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-cb4101b7-317e-446d-84ec-126469871b09 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:53.096301 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-cb4101b7-317e-446d-84ec-126469871b09 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:53.102533 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb4101b7-317e-446d-84ec-126469871b09 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:53.103050 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb4101b7-317e-446d-84ec-126469871b09 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:53.103489 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb4101b7-317e-446d-84ec-126469871b09 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:53.104180 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb4101b7-317e-446d-84ec-126469871b09 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:53.104638 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb4101b7-317e-446d-84ec-126469871b09 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:53.105059 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb4101b7-317e-446d-84ec-126469871b09 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:53.236048 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-cb4101b7-317e-446d-84ec-126469871b09 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:53.244998 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-cb4101b7-317e-446d-84ec-126469871b09 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1362 microversion: 2.1 time: 0.153967 Sep 18 01:00:53.245639 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 319/633] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:53 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:54.268177 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-dd4c7bab-11b0-4ad6-b941-7a5cc5e81627 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:54.270037 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-dd4c7bab-11b0-4ad6-b941-7a5cc5e81627 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:54.277981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dd4c7bab-11b0-4ad6-b941-7a5cc5e81627 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:54.278468 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dd4c7bab-11b0-4ad6-b941-7a5cc5e81627 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:54.278923 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dd4c7bab-11b0-4ad6-b941-7a5cc5e81627 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:54.279621 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dd4c7bab-11b0-4ad6-b941-7a5cc5e81627 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:54.280075 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dd4c7bab-11b0-4ad6-b941-7a5cc5e81627 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:54.280522 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dd4c7bab-11b0-4ad6-b941-7a5cc5e81627 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:54.408475 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-dd4c7bab-11b0-4ad6-b941-7a5cc5e81627 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:00:54.416353 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-dd4c7bab-11b0-4ad6-b941-7a5cc5e81627 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1548 microversion: 2.1 time: 0.152254 Sep 18 01:00:54.416924 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 315/634] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:00:54 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:00:54.438344 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-5a7bc024-51f8-4217-9d5a-469cc1f9487b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:54.438868 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-5a7bc024-51f8-4217-9d5a-469cc1f9487b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:54.445624 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a7bc024-51f8-4217-9d5a-469cc1f9487b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:54.446110 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a7bc024-51f8-4217-9d5a-469cc1f9487b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:54.446552 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a7bc024-51f8-4217-9d5a-469cc1f9487b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:54.447281 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a7bc024-51f8-4217-9d5a-469cc1f9487b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:54.447744 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a7bc024-51f8-4217-9d5a-469cc1f9487b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:54.448173 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5a7bc024-51f8-4217-9d5a-469cc1f9487b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:54.527700 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-5a7bc024-51f8-4217-9d5a-469cc1f9487b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093137 Sep 18 01:00:54.528303 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 320/635] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 18 01:00:54 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:55.378355 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3a4f2fdf-a593-40c3-b9b5-cc2b6025a38b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:55.378935 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3a4f2fdf-a593-40c3-b9b5-cc2b6025a38b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:55.385333 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a4f2fdf-a593-40c3-b9b5-cc2b6025a38b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:55.385824 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a4f2fdf-a593-40c3-b9b5-cc2b6025a38b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:55.386264 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a4f2fdf-a593-40c3-b9b5-cc2b6025a38b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:55.387008 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a4f2fdf-a593-40c3-b9b5-cc2b6025a38b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:55.387475 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a4f2fdf-a593-40c3-b9b5-cc2b6025a38b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:55.387910 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3a4f2fdf-a593-40c3-b9b5-cc2b6025a38b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:55.412065 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3a4f2fdf-a593-40c3-b9b5-cc2b6025a38b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/ips" status: 200 len: 149 microversion: 2.1 time: 0.038126 Sep 18 01:00:55.412637 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 316/636] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 18 01:00:55 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:55.463115 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-6c74af23-7344-44af-af8c-44f587f255cf req-fbfde26b-1bec-4be9-9f78-3437059065f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b63a4a6-ced3-44e7-ba27-44875b4943f4", "tag": "e361fc39-aed8-424c-893a-c016b77dcdc2"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:55.473990 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-6c74af23-7344-44af-af8c-44f587f255cf req-fbfde26b-1bec-4be9-9f78-3437059065f4 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:55.474488 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-6c74af23-7344-44af-af8c-44f587f255cf req-fbfde26b-1bec-4be9-9f78-3437059065f4 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:55.475318 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-6c74af23-7344-44af-af8c-44f587f255cf req-fbfde26b-1bec-4be9-9f78-3437059065f4 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:55.487994 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-6c74af23-7344-44af-af8c-44f587f255cf req-fbfde26b-1bec-4be9-9f78-3437059065f4 service nova] Creating event network-changed:e361fc39-aed8-424c-893a-c016b77dcdc2 for instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 on hv-cinder-maste Sep 18 01:00:55.492822 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-6c74af23-7344-44af-af8c-44f587f255cf req-fbfde26b-1bec-4be9-9f78-3437059065f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033966 Sep 18 01:00:55.493485 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 321/637] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:56.777200 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-90e7d656-6292-4824-a707-2194f47e2b5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1421aa9c-fbad-4c2f-8eac-9093298645a8"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:56.779657 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-90e7d656-6292-4824-a707-2194f47e2b5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:56.786003 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90e7d656-6292-4824-a707-2194f47e2b5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:56.786491 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90e7d656-6292-4824-a707-2194f47e2b5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:56.786954 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90e7d656-6292-4824-a707-2194f47e2b5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:56.787643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90e7d656-6292-4824-a707-2194f47e2b5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:56.788103 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90e7d656-6292-4824-a707-2194f47e2b5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:56.788528 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90e7d656-6292-4824-a707-2194f47e2b5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:57.071604 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-90e7d656-6292-4824-a707-2194f47e2b5a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298314 Sep 18 01:00:57.072362 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 317/638] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 01:00:56 2022] POST /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:00:59.327872 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1421aa9c-fbad-4c2f-8eac-9093298645a8"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:00:59.330977 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:59.337372 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:59.337906 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:59.338351 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:59.339083 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:59.339543 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:59.339971 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:59.531119 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Invalid volume: volume 1421aa9c-fbad-4c2f-8eac-9093298645a8 is already attached to instances: 27162b19-b4be-4478-8644-79f59ff58586 Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: POST /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-volume_attachments HTTP/1.1 Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 74 Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:00:59.532825 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: {"volumeAttachment": {"volumeId": "1421aa9c-fbad-4c2f-8eac-9093298645a8"}} Sep 18 01:00:59.535297 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Invalid volume: volume 1421aa9c-fbad-4c2f-8eac-9093298645a8 is already attached to instances: 27162b19-b4be-4478-8644-79f59ff58586 Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'server_id': '27162b19-b4be-4478-8644-79f59ff58586', 'body': {'volumeAttachment': {'volumeId': '1421aa9c-fbad-4c2f-8eac-9093298645a8'}}} Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1421aa9c-fbad-4c2f-8eac-9093298645a8 is already attached to instances: 27162b19-b4be-4478-8644-79f59ff58586 Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:59.536116 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1421aa9c-fbad-4c2f-8eac-9093298645a8 is already attached to instances: 27162b19-b4be-4478-8644-79f59ff58586 Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:00:59.537735 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:00:59.539172 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:00:59.539172 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:00:59.539172 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:00:59.539172 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1421aa9c-fbad-4c2f-8eac-9093298645a8 is already attached to instances: 27162b19-b4be-4478-8644-79f59ff58586 Sep 18 01:00:59.539172 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:00:59.539172 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 400 to user: Invalid volume: volume 1421aa9c-fbad-4c2f-8eac-9093298645a8 is already attached to instances: 27162b19-b4be-4478-8644-79f59ff58586 {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:00:59.539172 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c8cbd950-dbb2-4f7e-8352-7a3937666c7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.211993 Sep 18 01:00:59.539172 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 322/639] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 01:00:59 2022] POST /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-volume_attachments => generated 174 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:00:59.603458 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e0f82530-b2e5-412e-addf-79c00516ee97 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:59.604050 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e0f82530-b2e5-412e-addf-79c00516ee97 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:59.610207 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e0f82530-b2e5-412e-addf-79c00516ee97 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:59.610697 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e0f82530-b2e5-412e-addf-79c00516ee97 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:59.611168 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e0f82530-b2e5-412e-addf-79c00516ee97 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:59.611864 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e0f82530-b2e5-412e-addf-79c00516ee97 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:59.612331 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e0f82530-b2e5-412e-addf-79c00516ee97 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:59.612755 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e0f82530-b2e5-412e-addf-79c00516ee97 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:59.694112 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-e0f82530-b2e5-412e-addf-79c00516ee97 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lazy-loading 'services' on Instance uuid 27162b19-b4be-4478-8644-79f59ff58586 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:00:59.764245 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e0f82530-b2e5-412e-addf-79c00516ee97 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-volume_attachments/1421aa9c-fbad-4c2f-8eac-9093298645a8" status: 202 len: 0 microversion: 2.1 time: 0.165524 Sep 18 01:00:59.764832 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 318/640] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 01:00:59 2022] DELETE /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-volume_attachments/1421aa9c-fbad-4c2f-8eac-9093298645a8 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:00:59.773364 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f2392827-288a-41c8-82c6-89b33523a2a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:00:59.775612 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f2392827-288a-41c8-82c6-89b33523a2a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:00:59.782566 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2392827-288a-41c8-82c6-89b33523a2a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:59.783109 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2392827-288a-41c8-82c6-89b33523a2a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:59.784093 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2392827-288a-41c8-82c6-89b33523a2a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:59.785066 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2392827-288a-41c8-82c6-89b33523a2a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:00:59.785536 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2392827-288a-41c8-82c6-89b33523a2a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:00:59.785974 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f2392827-288a-41c8-82c6-89b33523a2a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:00:59.802998 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:59.818039 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f2392827-288a-41c8-82c6-89b33523a2a2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048550 Sep 18 01:00:59.818614 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 323/641] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:00:59 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:01:00.832283 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-072849ba-ff1e-4727-b700-9624e00e7dc2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.834651 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-072849ba-ff1e-4727-b700-9624e00e7dc2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:00.840950 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-072849ba-ff1e-4727-b700-9624e00e7dc2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:00.841438 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-072849ba-ff1e-4727-b700-9624e00e7dc2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:00.841869 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-072849ba-ff1e-4727-b700-9624e00e7dc2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:00.843022 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-072849ba-ff1e-4727-b700-9624e00e7dc2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:00.843132 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-072849ba-ff1e-4727-b700-9624e00e7dc2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:00.843490 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-072849ba-ff1e-4727-b700-9624e00e7dc2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:00.878116 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-072849ba-ff1e-4727-b700-9624e00e7dc2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051168 Sep 18 01:01:00.878994 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 319/642] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:01:00 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:00.943971 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8173d97f-1f07-43ac-aa74-afb8f013deae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:00.944499 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8173d97f-1f07-43ac-aa74-afb8f013deae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:00.951350 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8173d97f-1f07-43ac-aa74-afb8f013deae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:00.951840 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8173d97f-1f07-43ac-aa74-afb8f013deae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:00.952280 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8173d97f-1f07-43ac-aa74-afb8f013deae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:00.952984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8173d97f-1f07-43ac-aa74-afb8f013deae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:00.953445 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8173d97f-1f07-43ac-aa74-afb8f013deae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:00.953874 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8173d97f-1f07-43ac-aa74-afb8f013deae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:00.982197 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8173d97f-1f07-43ac-aa74-afb8f013deae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Going to try to terminate instance {{(pid=120686) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:01:01.062101 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8173d97f-1f07-43ac-aa74-afb8f013deae tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 204 len: 0 microversion: 2.1 time: 0.121587 Sep 18 01:01:01.062968 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 324/643] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:00 2022] DELETE /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:01.071863 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1a524d4b-0a24-465c-9872-cb2bc591326c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.072481 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1a524d4b-0a24-465c-9872-cb2bc591326c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:01.078439 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a524d4b-0a24-465c-9872-cb2bc591326c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:01.078974 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a524d4b-0a24-465c-9872-cb2bc591326c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:01.079419 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a524d4b-0a24-465c-9872-cb2bc591326c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:01.080109 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a524d4b-0a24-465c-9872-cb2bc591326c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:01.081154 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a524d4b-0a24-465c-9872-cb2bc591326c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:01.081584 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1a524d4b-0a24-465c-9872-cb2bc591326c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:01.261241 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1a524d4b-0a24-465c-9872-cb2bc591326c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:01.269029 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1a524d4b-0a24-465c-9872-cb2bc591326c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1681 microversion: 2.1 time: 0.201162 Sep 18 01:01:01.269594 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 320/644] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:01 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:01.619823 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-34eab2f8-87bc-4b4a-b627-55939b8f6be2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.620409 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-34eab2f8-87bc-4b4a-b627-55939b8f6be2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:01.626375 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34eab2f8-87bc-4b4a-b627-55939b8f6be2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:01.626901 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34eab2f8-87bc-4b4a-b627-55939b8f6be2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:01.627345 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34eab2f8-87bc-4b4a-b627-55939b8f6be2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:01.628049 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34eab2f8-87bc-4b4a-b627-55939b8f6be2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:01.628505 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34eab2f8-87bc-4b4a-b627-55939b8f6be2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:01.628934 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-34eab2f8-87bc-4b4a-b627-55939b8f6be2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:01.712984 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-34eab2f8-87bc-4b4a-b627-55939b8f6be2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lazy-loading 'services' on Instance uuid ecc591cc-e74d-48ea-85e8-945b2995d123 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:01.785379 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-34eab2f8-87bc-4b4a-b627-55939b8f6be2 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments/513ece0f-895c-4c87-b700-09bc943f03f0" status: 202 len: 0 microversion: 2.1 time: 0.169832 Sep 18 01:01:01.785961 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 325/645] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 01:01:01 2022] DELETE /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments/513ece0f-895c-4c87-b700-09bc943f03f0 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:01.794376 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-899334db-194c-4b8c-a6f4-2b66e1550db7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:01.796695 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-899334db-194c-4b8c-a6f4-2b66e1550db7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:01.803220 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-899334db-194c-4b8c-a6f4-2b66e1550db7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:01.803714 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-899334db-194c-4b8c-a6f4-2b66e1550db7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:01.804162 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-899334db-194c-4b8c-a6f4-2b66e1550db7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:01.804861 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-899334db-194c-4b8c-a6f4-2b66e1550db7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:01.805325 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-899334db-194c-4b8c-a6f4-2b66e1550db7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:01.805758 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-899334db-194c-4b8c-a6f4-2b66e1550db7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:01.836366 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-899334db-194c-4b8c-a6f4-2b66e1550db7 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046039 Sep 18 01:01:01.837012 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 321/646] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:01:01 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:02.293158 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-dc583bf1-73b2-4437-a21f-27e4f3e76922 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:02.293877 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-dc583bf1-73b2-4437-a21f-27e4f3e76922 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:02.300173 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc583bf1-73b2-4437-a21f-27e4f3e76922 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:02.300656 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc583bf1-73b2-4437-a21f-27e4f3e76922 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:02.301095 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc583bf1-73b2-4437-a21f-27e4f3e76922 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:02.301793 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc583bf1-73b2-4437-a21f-27e4f3e76922 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:02.302251 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc583bf1-73b2-4437-a21f-27e4f3e76922 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:02.302678 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc583bf1-73b2-4437-a21f-27e4f3e76922 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:02.433880 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-dc583bf1-73b2-4437-a21f-27e4f3e76922 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:02.441755 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-dc583bf1-73b2-4437-a21f-27e4f3e76922 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1681 microversion: 2.1 time: 0.153466 Sep 18 01:01:02.442312 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 326/647] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:02 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:02.849908 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-65842ad8-5f5c-4211-ade5-6c914a3d5b88 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:02.852132 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-65842ad8-5f5c-4211-ade5-6c914a3d5b88 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:02.858773 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-65842ad8-5f5c-4211-ade5-6c914a3d5b88 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:02.859302 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-65842ad8-5f5c-4211-ade5-6c914a3d5b88 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:02.859754 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-65842ad8-5f5c-4211-ade5-6c914a3d5b88 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:02.860465 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-65842ad8-5f5c-4211-ade5-6c914a3d5b88 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:02.860927 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-65842ad8-5f5c-4211-ade5-6c914a3d5b88 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:02.861366 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-65842ad8-5f5c-4211-ade5-6c914a3d5b88 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:02.893385 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-65842ad8-5f5c-4211-ade5-6c914a3d5b88 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046839 Sep 18 01:01:02.894276 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 322/648] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:01:02 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:03.465373 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-db1a2917-ec72-42e8-a170-90954e279b26 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:03.465982 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-db1a2917-ec72-42e8-a170-90954e279b26 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:03.473556 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-db1a2917-ec72-42e8-a170-90954e279b26 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.474290 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-db1a2917-ec72-42e8-a170-90954e279b26 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.475022 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-db1a2917-ec72-42e8-a170-90954e279b26 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:03.475910 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-db1a2917-ec72-42e8-a170-90954e279b26 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.476522 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-db1a2917-ec72-42e8-a170-90954e279b26 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.477114 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-db1a2917-ec72-42e8-a170-90954e279b26 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:03.660314 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-db1a2917-ec72-42e8-a170-90954e279b26 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:03.669834 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-db1a2917-ec72-42e8-a170-90954e279b26 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1681 microversion: 2.1 time: 0.208042 Sep 18 01:01:03.672051 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 327/649] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:03 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:03.906461 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d24ba19c-1034-4634-9aec-5ec736aabc64 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:03.908892 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d24ba19c-1034-4634-9aec-5ec736aabc64 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:03.916771 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d24ba19c-1034-4634-9aec-5ec736aabc64 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.916957 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d24ba19c-1034-4634-9aec-5ec736aabc64 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.917296 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d24ba19c-1034-4634-9aec-5ec736aabc64 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:03.918030 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d24ba19c-1034-4634-9aec-5ec736aabc64 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:03.918497 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d24ba19c-1034-4634-9aec-5ec736aabc64 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:03.918976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d24ba19c-1034-4634-9aec-5ec736aabc64 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:03.954553 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d24ba19c-1034-4634-9aec-5ec736aabc64 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052294 Sep 18 01:01:03.962112 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 323/650] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:01:03 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:04.695979 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-51a4bee1-be3a-4e3b-99a1-ff95320d4fdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.696690 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-51a4bee1-be3a-4e3b-99a1-ff95320d4fdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:04.703381 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51a4bee1-be3a-4e3b-99a1-ff95320d4fdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:04.703869 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51a4bee1-be3a-4e3b-99a1-ff95320d4fdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:04.704305 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51a4bee1-be3a-4e3b-99a1-ff95320d4fdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:04.705006 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51a4bee1-be3a-4e3b-99a1-ff95320d4fdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:04.706113 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51a4bee1-be3a-4e3b-99a1-ff95320d4fdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:04.706566 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51a4bee1-be3a-4e3b-99a1-ff95320d4fdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:04.801306 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-51a4bee1-be3a-4e3b-99a1-ff95320d4fdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:04.815283 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-d3667889-5e8f-4a4e-ace0-3c5d22d2622b req-33e7c7e2-c17e-42b2-9507-c024c0d5b240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27162b19-b4be-4478-8644-79f59ff58586", "name": "network-vif-deleted", "tag": "676125cb-60fb-496b-b796-92d00340f299"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:04.819917 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-51a4bee1-be3a-4e3b-99a1-ff95320d4fdc tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1614 microversion: 2.1 time: 0.127620 Sep 18 01:01:04.821084 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 328/651] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:04 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1614 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:04.825139 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-d3667889-5e8f-4a4e-ace0-3c5d22d2622b req-33e7c7e2-c17e-42b2-9507-c024c0d5b240 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:04.825640 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-d3667889-5e8f-4a4e-ace0-3c5d22d2622b req-33e7c7e2-c17e-42b2-9507-c024c0d5b240 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:04.826077 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-d3667889-5e8f-4a4e-ace0-3c5d22d2622b req-33e7c7e2-c17e-42b2-9507-c024c0d5b240 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:04.838228 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-d3667889-5e8f-4a4e-ace0-3c5d22d2622b req-33e7c7e2-c17e-42b2-9507-c024c0d5b240 service nova] Creating event network-vif-deleted:676125cb-60fb-496b-b796-92d00340f299 for instance 27162b19-b4be-4478-8644-79f59ff58586 on hv-cinder-maste Sep 18 01:01:04.842966 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-d3667889-5e8f-4a4e-ace0-3c5d22d2622b req-33e7c7e2-c17e-42b2-9507-c024c0d5b240 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031867 Sep 18 01:01:04.843565 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 324/652] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:01:04.968358 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c5f7fe81-f832-4308-b24a-95aa4a3f4178 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:04.976104 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c5f7fe81-f832-4308-b24a-95aa4a3f4178 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:04.984571 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5f7fe81-f832-4308-b24a-95aa4a3f4178 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:04.985650 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5f7fe81-f832-4308-b24a-95aa4a3f4178 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:04.990886 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5f7fe81-f832-4308-b24a-95aa4a3f4178 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:04.992057 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5f7fe81-f832-4308-b24a-95aa4a3f4178 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:04.992648 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5f7fe81-f832-4308-b24a-95aa4a3f4178 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:04.993711 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5f7fe81-f832-4308-b24a-95aa4a3f4178 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.030163 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c5f7fe81-f832-4308-b24a-95aa4a3f4178 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066676 Sep 18 01:01:05.031591 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 329/653] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:01:04 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 18 01:01:05.114464 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-433ed8b3-7812-4832-a7ce-168f25ec0fbc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:05.115083 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-433ed8b3-7812-4832-a7ce-168f25ec0fbc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:05.121678 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-433ed8b3-7812-4832-a7ce-168f25ec0fbc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.122184 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-433ed8b3-7812-4832-a7ce-168f25ec0fbc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.122654 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-433ed8b3-7812-4832-a7ce-168f25ec0fbc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.123380 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-433ed8b3-7812-4832-a7ce-168f25ec0fbc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.123841 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-433ed8b3-7812-4832-a7ce-168f25ec0fbc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.124270 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-433ed8b3-7812-4832-a7ce-168f25ec0fbc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.153398 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-433ed8b3-7812-4832-a7ce-168f25ec0fbc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Going to try to terminate instance {{(pid=120687) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:01:05.245132 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-433ed8b3-7812-4832-a7ce-168f25ec0fbc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 204 len: 0 microversion: 2.1 time: 0.135099 Sep 18 01:01:05.246171 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 325/654] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:05 2022] DELETE /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:05.254883 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0e22d6d0-7e8d-4e8b-9287-13d0b90a08cf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:05.255813 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0e22d6d0-7e8d-4e8b-9287-13d0b90a08cf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:05.262691 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e22d6d0-7e8d-4e8b-9287-13d0b90a08cf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.263212 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e22d6d0-7e8d-4e8b-9287-13d0b90a08cf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.263844 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e22d6d0-7e8d-4e8b-9287-13d0b90a08cf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.264730 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e22d6d0-7e8d-4e8b-9287-13d0b90a08cf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.265192 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e22d6d0-7e8d-4e8b-9287-13d0b90a08cf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.265618 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0e22d6d0-7e8d-4e8b-9287-13d0b90a08cf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.398525 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-0e22d6d0-7e8d-4e8b-9287-13d0b90a08cf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:05.406363 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0e22d6d0-7e8d-4e8b-9287-13d0b90a08cf tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1691 microversion: 2.1 time: 0.155884 Sep 18 01:01:05.407137 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 330/655] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:05 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:05.846770 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:05.847731 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:05.853327 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.853812 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.854246 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.854963 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.855418 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.855869 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.888743 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:05.889250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:05.889672 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:05.890113 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lazy-loading 'fault' on Instance uuid 27162b19-b4be-4478-8644-79f59ff58586 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:05.935336 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:05.943689 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-95f4e282-4348-4afa-a6a9-f7b51ca48b66 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1332 microversion: 2.1 time: 0.102345 Sep 18 01:01:05.944248 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 326/656] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:05 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:06.429626 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-09a15b9d-56a9-48b1-9a00-7e6714234fb9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:06.430265 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-09a15b9d-56a9-48b1-9a00-7e6714234fb9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:06.436800 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a15b9d-56a9-48b1-9a00-7e6714234fb9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.437288 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a15b9d-56a9-48b1-9a00-7e6714234fb9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.437721 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a15b9d-56a9-48b1-9a00-7e6714234fb9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.438407 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a15b9d-56a9-48b1-9a00-7e6714234fb9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.438991 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a15b9d-56a9-48b1-9a00-7e6714234fb9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.439425 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-09a15b9d-56a9-48b1-9a00-7e6714234fb9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.565175 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-09a15b9d-56a9-48b1-9a00-7e6714234fb9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:06.572841 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-09a15b9d-56a9-48b1-9a00-7e6714234fb9 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1691 microversion: 2.1 time: 0.147093 Sep 18 01:01:06.573408 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 331/657] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:06 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1691 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:06.967586 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:06.968622 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:06.975685 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.976172 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.976604 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:06.977295 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:06.977776 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:06.978200 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:07.009348 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:07.009823 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:07.010250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:07.010686 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lazy-loading 'fault' on Instance uuid 27162b19-b4be-4478-8644-79f59ff58586 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:07.013427 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:07.052568 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:07.060122 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5154032d-ef96-40ae-a709-7e426acd7cd2 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1332 microversion: 2.1 time: 0.096740 Sep 18 01:01:07.060678 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 327/658] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:06 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:07.595098 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ac7bb407-fd21-4be0-8ce9-90ca94b23a10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:07.595817 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ac7bb407-fd21-4be0-8ce9-90ca94b23a10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:07.598291 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:07.603574 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac7bb407-fd21-4be0-8ce9-90ca94b23a10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:07.604065 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac7bb407-fd21-4be0-8ce9-90ca94b23a10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:07.604502 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac7bb407-fd21-4be0-8ce9-90ca94b23a10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:07.605201 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac7bb407-fd21-4be0-8ce9-90ca94b23a10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:07.605659 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac7bb407-fd21-4be0-8ce9-90ca94b23a10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:07.606083 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ac7bb407-fd21-4be0-8ce9-90ca94b23a10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:07.737028 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ac7bb407-fd21-4be0-8ce9-90ca94b23a10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:07.745006 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ac7bb407-fd21-4be0-8ce9-90ca94b23a10 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1691 microversion: 2.1 time: 0.153841 Sep 18 01:01:07.745573 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 332/659] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:07 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:08.084364 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:08.085050 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:08.091482 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:08.091961 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:08.092389 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.093070 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:08.093525 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:08.093948 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.127758 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:08.128161 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:08.128587 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.129023 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lazy-loading 'fault' on Instance uuid 27162b19-b4be-4478-8644-79f59ff58586 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:08.168884 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:08.177192 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-fc5c99e4-6fa8-47f3-98d2-cbc7358627d8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1332 microversion: 2.1 time: 0.097252 Sep 18 01:01:08.177757 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 328/660] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:08 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:08.769114 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c52231fe-30eb-4629-9e7c-5b485b48ee84 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:08.769730 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c52231fe-30eb-4629-9e7c-5b485b48ee84 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:08.776184 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c52231fe-30eb-4629-9e7c-5b485b48ee84 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:08.776679 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c52231fe-30eb-4629-9e7c-5b485b48ee84 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:08.777120 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c52231fe-30eb-4629-9e7c-5b485b48ee84 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.777825 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c52231fe-30eb-4629-9e7c-5b485b48ee84 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:08.778286 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c52231fe-30eb-4629-9e7c-5b485b48ee84 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:08.778715 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c52231fe-30eb-4629-9e7c-5b485b48ee84 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:08.907272 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c52231fe-30eb-4629-9e7c-5b485b48ee84 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:08.915102 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c52231fe-30eb-4629-9e7c-5b485b48ee84 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1691 microversion: 2.1 time: 0.150611 Sep 18 01:01:08.915664 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 333/661] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:08 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:09.199802 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:09.200434 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:09.207006 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:09.207489 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:09.207919 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:09.208600 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:09.209051 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:09.209500 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:09.243087 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:09.243577 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:09.244262 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:09.244706 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lazy-loading 'fault' on Instance uuid 27162b19-b4be-4478-8644-79f59ff58586 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:09.292639 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:09.301223 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a4c6dc55-d9db-456c-9b49-4ba39c2d0b7e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 200 len: 1332 microversion: 2.1 time: 0.105273 Sep 18 01:01:09.301787 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 329/662] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:09 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:09.938920 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-12c43d65-3f19-45e2-8238-72e23c44045e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:09.939607 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-12c43d65-3f19-45e2-8238-72e23c44045e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:09.947312 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12c43d65-3f19-45e2-8238-72e23c44045e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:09.947819 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12c43d65-3f19-45e2-8238-72e23c44045e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:09.948256 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12c43d65-3f19-45e2-8238-72e23c44045e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:09.948968 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12c43d65-3f19-45e2-8238-72e23c44045e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:09.949681 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12c43d65-3f19-45e2-8238-72e23c44045e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:09.950118 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-12c43d65-3f19-45e2-8238-72e23c44045e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:10.019090 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-12c43d65-3f19-45e2-8238-72e23c44045e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:10.027023 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-12c43d65-3f19-45e2-8238-72e23c44045e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1623 microversion: 2.1 time: 0.092343 Sep 18 01:01:10.027656 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 334/663] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:09 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1623 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:10.325564 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:10.326895 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:10.334270 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:10.338369 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:10.339138 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:10.340000 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:10.340526 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:10.341033 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:10.355983 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 HTTP/1.1 Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:01:10.358151 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:01:10.359591 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '27162b19-b4be-4478-8644-79f59ff58586'} Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:10.360380 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:01:10.361957 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:10.364380 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:10.364380 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-88c28e3a-a791-47d3-b4a5-3e2cf1fb0815 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 404 len: 111 microversion: 2.1 time: 0.037899 Sep 18 01:01:10.368942 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-24b68d77-28f7-45d5-8e11-3166b232e29f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '.version_select at 0x7f5672999280>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:10.375006 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 330/664] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:10 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:10.395687 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-24b68d77-28f7-45d5-8e11-3166b232e29f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769906644" status: 202 len: 0 microversion: 2.1 time: 0.030704 Sep 18 01:01:10.396271 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 335/665] 10.222.0.33 () {58 vars in 1221 bytes} [Sun Sep 18 01:01:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769906644 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:10.471126 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-14a7cf98-27f8-4cf0-b437-0fbcdc5988a0 req-1a8b6c93-5c69-4555-976c-6bb3a0a1f87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc591cc-e74d-48ea-85e8-945b2995d123", "name": "network-vif-deleted", "tag": "9608eb83-8531-414f-a482-f625b3b31cb2"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:10.484755 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-14a7cf98-27f8-4cf0-b437-0fbcdc5988a0 req-1a8b6c93-5c69-4555-976c-6bb3a0a1f87d service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:10.485493 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-14a7cf98-27f8-4cf0-b437-0fbcdc5988a0 req-1a8b6c93-5c69-4555-976c-6bb3a0a1f87d service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:10.486455 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-14a7cf98-27f8-4cf0-b437-0fbcdc5988a0 req-1a8b6c93-5c69-4555-976c-6bb3a0a1f87d service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:10.506501 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-14a7cf98-27f8-4cf0-b437-0fbcdc5988a0 req-1a8b6c93-5c69-4555-976c-6bb3a0a1f87d service nova] Creating event network-vif-deleted:9608eb83-8531-414f-a482-f625b3b31cb2 for instance ecc591cc-e74d-48ea-85e8-945b2995d123 on hv-cinder-maste Sep 18 01:01:10.513742 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-14a7cf98-27f8-4cf0-b437-0fbcdc5988a0 req-1a8b6c93-5c69-4555-976c-6bb3a0a1f87d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047362 Sep 18 01:01:10.514561 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 331/666] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:11.054020 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:11.055251 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:11.062225 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:11.063005 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:11.063717 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:11.064763 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:11.065289 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:11.065787 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:11.072553 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-72dd8a2f-0a87-4039-95be-675b219d61b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: .version_select at 0x7f5672a468b0>, body: {"keypair": {"name": "tempest-keypair-541189452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkpnGc7M8iFH543sP6uIKhUwSWbpadECCR2DUwNc49WH1dyVE9QDFV+vCAg/H1xvPDUSIQ6PoarbMQ7DAw/ZJ04sXwFzhxlxYiD1qf++mw8SGoIJcT1sQk4syktxDQEOg=="}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:11.088025 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-72dd8a2f-0a87-4039-95be-675b219d61b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:11.092269 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-72dd8a2f-0a87-4039-95be-675b219d61b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for user f19ac9f3986640ae9b7993b98dd403c0 and project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'key_pairs'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:11.109521 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:11.109977 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:11.110598 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:11.111575 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lazy-loading 'fault' on Instance uuid ecc591cc-e74d-48ea-85e8-945b2995d123 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:11.116731 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-72dd8a2f-0a87-4039-95be-675b219d61b9 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048331 Sep 18 01:01:11.117489 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 332/667] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 18 01:01:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:01:11.416121 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:11.423854 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-21568769-5c03-44c2-ac12-43f5177ca36e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 200 len: 1336 microversion: 2.1 time: 0.378003 Sep 18 01:01:11.424433 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 336/668] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:11 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 1336 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:12.446669 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:12.447327 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: ecc591cc-e74d-48ea-85e8-945b2995d123] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:12.453355 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:12.453839 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:12.454358 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:12.455356 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:12.455816 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:12.456242 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:12.470522 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] HTTP exception thrown: Instance ecc591cc-e74d-48ea-85e8-945b2995d123 could not be found. Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Request method failure captured: Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 HTTP/1.1 Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy31mVmknuEEFVFaU-1XS-k0H1_yKxD0sx28JFsSSlFMJsEGR28zy2XJpRMQQN1x9OLqPLv25JxF5nxicUtHMc-A7k80RvI3QkvK9qwQ0XmK7UZaXL5gu4ruu-xgYOgeYvpm0dpbuXBtjB2YPKKLVqNnntObPsdpKJX6vJQT6ziakM Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: 8cbf74b218c04911bb921f7cc2c6e966 Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:01:12.472538 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8cbf74b218c04911bb921f7cc2c6e966"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8cbf74b218c04911bb921f7cc2c6e966"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8cbf74b218c04911bb921f7cc2c6e966", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8cbf74b218c04911bb921f7cc2c6e966"}]}] Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: 8cbf74b218c04911bb921f7cc2c6e966 Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-ServerRescueNegativeTestJSON-233879556-project Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 4d84f31e15924d3c8dbd7aac8a0f3576 Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-ServerRescueNegativeTestJSON-233879556-project Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance ecc591cc-e74d-48ea-85e8-945b2995d123 could not be found. Sep 18 01:01:12.474206 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': 'ecc591cc-e74d-48ea-85e8-945b2995d123'} Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc591cc-e74d-48ea-85e8-945b2995d123 could not be found. Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:12.475056 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc591cc-e74d-48ea-85e8-945b2995d123 could not be found. Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc591cc-e74d-48ea-85e8-945b2995d123 could not be found. Sep 18 01:01:12.476322 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:12.477493 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Returning 404 to user: Instance ecc591cc-e74d-48ea-85e8-945b2995d123 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:12.477493 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-68699471-0afd-4029-b44d-20f4b16619ba tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123" status: 404 len: 111 microversion: 2.1 time: 0.031765 Sep 18 01:01:12.477493 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 333/669] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:12 2022] GET /compute/v2.1/servers/ecc591cc-e74d-48ea-85e8-945b2995d123 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:12.482657 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e3ebad9a-dddd-4d55-b37e-0aaf3cef90b8 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '.version_select at 0x7f56729f93a0>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:12.502472 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e3ebad9a-dddd-4d55-b37e-0aaf3cef90b8 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984837072" status: 202 len: 0 microversion: 2.1 time: 0.023395 Sep 18 01:01:12.503353 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 337/670] 10.222.0.33 () {58 vars in 1221 bytes} [Sun Sep 18 01:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984837072 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:12.685103 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1893631867", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eee7c814-dc91-4de0-b55e-0732fcd7c9de"}], "security_groups": [{"name": "tempest-securitygroup--838326967"}], "key_name": "tempest-keypair-541189452", "user_data": "}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:12.796884 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] validate_networks() for [('eee7c814-dc91-4de0-b55e-0732fcd7c9de', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:01:13.184658 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:01:13.185123 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:01:13.185565 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:01:13.185990 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:01:13.186396 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:01:13.196151 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:13.196680 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:13.197121 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:13.197860 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:13.198323 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:13.198754 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:13.216408 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:01:13.220985 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Getting quotas for user f19ac9f3986640ae9b7993b98dd403c0 and project ec2d9e20d4ed4178b9bc68ff54715b18. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:01:13.232469 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:01:13.234810 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:01:13.281448 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1c68d697-717c-4c23-b356-0a81bc850e07 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.600793 Sep 18 01:01:13.282099 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 334/671] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 01:01:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:01:13.293659 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-56212f46-090b-4fde-9b74-75cc88c806c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:13.294277 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-56212f46-090b-4fde-9b74-75cc88c806c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:13.350097 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-56212f46-090b-4fde-9b74-75cc88c806c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:13.358812 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-56212f46-090b-4fde-9b74-75cc88c806c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1241 microversion: 2.1 time: 0.068873 Sep 18 01:01:13.359475 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 338/672] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:13 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:14.384413 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-93578df4-4ea8-407d-a87d-b925c92a3050 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:14.385011 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-93578df4-4ea8-407d-a87d-b925c92a3050 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:14.391174 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-93578df4-4ea8-407d-a87d-b925c92a3050 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:14.391681 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-93578df4-4ea8-407d-a87d-b925c92a3050 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:14.392435 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-93578df4-4ea8-407d-a87d-b925c92a3050 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:14.393165 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-93578df4-4ea8-407d-a87d-b925c92a3050 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:14.393622 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-93578df4-4ea8-407d-a87d-b925c92a3050 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:14.394046 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-93578df4-4ea8-407d-a87d-b925c92a3050 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:14.457004 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-93578df4-4ea8-407d-a87d-b925c92a3050 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:14.464530 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-93578df4-4ea8-407d-a87d-b925c92a3050 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1293 microversion: 2.1 time: 0.085082 Sep 18 01:01:14.465093 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 335/673] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:14 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:15.417654 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0eb38191-d987-4064-9098-463240d9909c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:15.418150 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0eb38191-d987-4064-9098-463240d9909c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:15.425534 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0eb38191-d987-4064-9098-463240d9909c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:15.426021 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0eb38191-d987-4064-9098-463240d9909c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:15.426450 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0eb38191-d987-4064-9098-463240d9909c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:15.427808 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0eb38191-d987-4064-9098-463240d9909c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:15.428673 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0eb38191-d987-4064-9098-463240d9909c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:15.429657 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0eb38191-d987-4064-9098-463240d9909c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:15.460839 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0eb38191-d987-4064-9098-463240d9909c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Going to try to terminate instance {{(pid=120686) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:01:15.487986 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5e9b88a1-d6c3-48d5-9938-e7e9063fe64e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:15.489334 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5e9b88a1-d6c3-48d5-9938-e7e9063fe64e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:15.496413 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5e9b88a1-d6c3-48d5-9938-e7e9063fe64e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:15.497274 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5e9b88a1-d6c3-48d5-9938-e7e9063fe64e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:15.497933 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5e9b88a1-d6c3-48d5-9938-e7e9063fe64e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:15.498898 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5e9b88a1-d6c3-48d5-9938-e7e9063fe64e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:15.499731 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5e9b88a1-d6c3-48d5-9938-e7e9063fe64e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:15.501631 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5e9b88a1-d6c3-48d5-9938-e7e9063fe64e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:15.505261 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:15.563031 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0eb38191-d987-4064-9098-463240d9909c tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "DELETE /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 204 len: 0 microversion: 2.1 time: 0.148562 Sep 18 01:01:15.581413 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 339/674] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:15 2022] DELETE /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:15.590081 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-dc76c312-4669-4e7b-915a-7c9ba1f53aff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:15.592580 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-dc76c312-4669-4e7b-915a-7c9ba1f53aff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:15.610608 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc76c312-4669-4e7b-915a-7c9ba1f53aff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:15.611292 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc76c312-4669-4e7b-915a-7c9ba1f53aff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:15.611799 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc76c312-4669-4e7b-915a-7c9ba1f53aff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:15.612714 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc76c312-4669-4e7b-915a-7c9ba1f53aff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:15.613248 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc76c312-4669-4e7b-915a-7c9ba1f53aff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:15.613875 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-dc76c312-4669-4e7b-915a-7c9ba1f53aff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:15.673615 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5e9b88a1-d6c3-48d5-9938-e7e9063fe64e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:15.681685 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5e9b88a1-d6c3-48d5-9938-e7e9063fe64e tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1366 microversion: 2.1 time: 0.197549 Sep 18 01:01:15.682254 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 336/675] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:15 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:15.759089 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-dc76c312-4669-4e7b-915a-7c9ba1f53aff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:15.766987 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-dc76c312-4669-4e7b-915a-7c9ba1f53aff tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1509 microversion: 2.1 time: 0.181051 Sep 18 01:01:15.767579 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 340/676] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:15 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:16.123750 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-cfa4ed26-b353-4c44-b35c-613b72933e72 req-77914fbd-2009-4d1e-8217-8af69b0c8400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc449a97-775f-4dad-8aa1-e12326cfdc88", "tag": "5716e21d-3ed3-4b50-ba82-2ad48f1eb0c2"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:16.133483 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-cfa4ed26-b353-4c44-b35c-613b72933e72 req-77914fbd-2009-4d1e-8217-8af69b0c8400 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:16.133962 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-cfa4ed26-b353-4c44-b35c-613b72933e72 req-77914fbd-2009-4d1e-8217-8af69b0c8400 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:16.134390 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-cfa4ed26-b353-4c44-b35c-613b72933e72 req-77914fbd-2009-4d1e-8217-8af69b0c8400 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:16.147593 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-cfa4ed26-b353-4c44-b35c-613b72933e72 req-77914fbd-2009-4d1e-8217-8af69b0c8400 service nova] Creating event network-changed:5716e21d-3ed3-4b50-ba82-2ad48f1eb0c2 for instance dc449a97-775f-4dad-8aa1-e12326cfdc88 on hv-cinder-maste Sep 18 01:01:16.152288 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-cfa4ed26-b353-4c44-b35c-613b72933e72 req-77914fbd-2009-4d1e-8217-8af69b0c8400 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032244 Sep 18 01:01:16.153048 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 337/677] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:16.706338 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-11dcc78e-10a7-417b-b60c-cf53d5a185fe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:16.707027 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-11dcc78e-10a7-417b-b60c-cf53d5a185fe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:16.713447 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11dcc78e-10a7-417b-b60c-cf53d5a185fe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:16.713928 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11dcc78e-10a7-417b-b60c-cf53d5a185fe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:16.714364 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11dcc78e-10a7-417b-b60c-cf53d5a185fe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:16.715090 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11dcc78e-10a7-417b-b60c-cf53d5a185fe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:16.715553 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11dcc78e-10a7-417b-b60c-cf53d5a185fe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:16.715973 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11dcc78e-10a7-417b-b60c-cf53d5a185fe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:16.790469 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d6b307f3-6821-4984-af1f-489e9aa9ec8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:16.791194 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d6b307f3-6821-4984-af1f-489e9aa9ec8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:16.797329 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6b307f3-6821-4984-af1f-489e9aa9ec8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:16.797816 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6b307f3-6821-4984-af1f-489e9aa9ec8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:16.798256 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6b307f3-6821-4984-af1f-489e9aa9ec8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:16.799042 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6b307f3-6821-4984-af1f-489e9aa9ec8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:16.799508 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6b307f3-6821-4984-af1f-489e9aa9ec8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:16.799938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d6b307f3-6821-4984-af1f-489e9aa9ec8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:16.856316 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-11dcc78e-10a7-417b-b60c-cf53d5a185fe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:16.864057 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-11dcc78e-10a7-417b-b60c-cf53d5a185fe tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1366 microversion: 2.1 time: 0.162417 Sep 18 01:01:16.880076 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 341/678] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:16 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:16.939309 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d6b307f3-6821-4984-af1f-489e9aa9ec8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:16.946930 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d6b307f3-6821-4984-af1f-489e9aa9ec8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1509 microversion: 2.1 time: 0.161124 Sep 18 01:01:16.947490 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 338/679] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:16 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:17.887783 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-20e9fd8b-da40-44b0-90a2-c8b8b8efaa25 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:17.888417 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-20e9fd8b-da40-44b0-90a2-c8b8b8efaa25 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:17.895451 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-20e9fd8b-da40-44b0-90a2-c8b8b8efaa25 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:17.895938 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-20e9fd8b-da40-44b0-90a2-c8b8b8efaa25 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:17.896375 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-20e9fd8b-da40-44b0-90a2-c8b8b8efaa25 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:17.897071 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-20e9fd8b-da40-44b0-90a2-c8b8b8efaa25 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:17.897526 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-20e9fd8b-da40-44b0-90a2-c8b8b8efaa25 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:17.897949 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-20e9fd8b-da40-44b0-90a2-c8b8b8efaa25 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:17.973704 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d5ac0157-63d1-408e-bbe9-1e6939cfe3fc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:17.974557 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d5ac0157-63d1-408e-bbe9-1e6939cfe3fc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:17.981216 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5ac0157-63d1-408e-bbe9-1e6939cfe3fc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:17.981802 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5ac0157-63d1-408e-bbe9-1e6939cfe3fc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:17.982311 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5ac0157-63d1-408e-bbe9-1e6939cfe3fc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:17.983117 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5ac0157-63d1-408e-bbe9-1e6939cfe3fc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:17.983708 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5ac0157-63d1-408e-bbe9-1e6939cfe3fc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:17.984198 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5ac0157-63d1-408e-bbe9-1e6939cfe3fc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:18.039036 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-20e9fd8b-da40-44b0-90a2-c8b8b8efaa25 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:18.046898 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-20e9fd8b-da40-44b0-90a2-c8b8b8efaa25 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1366 microversion: 2.1 time: 0.163001 Sep 18 01:01:18.048279 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 342/680] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:17 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:18.122155 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d5ac0157-63d1-408e-bbe9-1e6939cfe3fc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:18.130547 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d5ac0157-63d1-408e-bbe9-1e6939cfe3fc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1509 microversion: 2.1 time: 0.164803 Sep 18 01:01:18.131147 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 339/681] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:17 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:18.702497 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-77e8cdaf-1625-47d6-a38d-f0f98cc85b69 req-8abb7a47-cadf-4ffa-b348-cc0faa474e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728", "name": "network-vif-deleted", "tag": "1598d49e-579f-48e5-a374-9f7da048ec3a"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:18.712799 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-77e8cdaf-1625-47d6-a38d-f0f98cc85b69 req-8abb7a47-cadf-4ffa-b348-cc0faa474e08 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:18.713289 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-77e8cdaf-1625-47d6-a38d-f0f98cc85b69 req-8abb7a47-cadf-4ffa-b348-cc0faa474e08 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:18.713720 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-77e8cdaf-1625-47d6-a38d-f0f98cc85b69 req-8abb7a47-cadf-4ffa-b348-cc0faa474e08 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:18.725816 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-77e8cdaf-1625-47d6-a38d-f0f98cc85b69 req-8abb7a47-cadf-4ffa-b348-cc0faa474e08 service nova] Creating event network-vif-deleted:1598d49e-579f-48e5-a374-9f7da048ec3a for instance 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 on hv-cinder-maste Sep 18 01:01:18.730839 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-77e8cdaf-1625-47d6-a38d-f0f98cc85b69 req-8abb7a47-cadf-4ffa-b348-cc0faa474e08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033161 Sep 18 01:01:18.731441 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 343/682] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:19.069738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-68c9a207-fa70-4352-89c8-8a359706b05a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:19.070449 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-68c9a207-fa70-4352-89c8-8a359706b05a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:19.077365 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68c9a207-fa70-4352-89c8-8a359706b05a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:19.077974 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68c9a207-fa70-4352-89c8-8a359706b05a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:19.078515 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68c9a207-fa70-4352-89c8-8a359706b05a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:19.079328 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68c9a207-fa70-4352-89c8-8a359706b05a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:19.079960 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68c9a207-fa70-4352-89c8-8a359706b05a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:19.080454 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-68c9a207-fa70-4352-89c8-8a359706b05a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:19.153725 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:19.154413 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:19.161458 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:19.161944 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:19.162377 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:19.163145 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:19.163600 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:19.164022 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:19.197331 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:19.197812 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:19.198243 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:19.198683 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lazy-loading 'fault' on Instance uuid 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:19.211885 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-68c9a207-fa70-4352-89c8-8a359706b05a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:19.219809 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-68c9a207-fa70-4352-89c8-8a359706b05a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1366 microversion: 2.1 time: 0.153823 Sep 18 01:01:19.220390 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 340/683] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:19 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:19.239596 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:19.248012 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-45dd11d3-7569-4a48-9fcc-fabe5a06ed8e tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1312 microversion: 2.1 time: 0.098951 Sep 18 01:01:19.248638 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 344/684] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:19 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:20.242657 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a8b8b7d6-c721-4c02-8068-682293163f1b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:20.243485 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a8b8b7d6-c721-4c02-8068-682293163f1b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:20.245922 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:20.252341 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8b8b7d6-c721-4c02-8068-682293163f1b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.252831 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8b8b7d6-c721-4c02-8068-682293163f1b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.253272 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8b8b7d6-c721-4c02-8068-682293163f1b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.253967 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8b8b7d6-c721-4c02-8068-682293163f1b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.254677 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8b8b7d6-c721-4c02-8068-682293163f1b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.254853 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a8b8b7d6-c721-4c02-8068-682293163f1b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.271130 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:20.271740 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:20.284174 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.284694 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.285159 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.285890 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.286348 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.286779 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.324409 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:20.324906 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:20.325861 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:20.325861 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lazy-loading 'fault' on Instance uuid 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:20.389193 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:20.397923 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-26eb1cfe-3233-4731-8a9e-3bddfd82dd4a tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 200 len: 1312 microversion: 2.1 time: 0.130624 Sep 18 01:01:20.398501 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 345/685] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:20 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:20.415253 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a8b8b7d6-c721-4c02-8068-682293163f1b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:20.424000 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a8b8b7d6-c721-4c02-8068-682293163f1b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1366 microversion: 2.1 time: 0.185145 Sep 18 01:01:20.424579 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 341/686] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:20 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:21.071115 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-73e3b3d1-b670-44ad-bc68-f010ab608e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:21.071616 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-73e3b3d1-b670-44ad-bc68-f010ab608e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:21.077543 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73e3b3d1-b670-44ad-bc68-f010ab608e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.078032 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73e3b3d1-b670-44ad-bc68-f010ab608e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.078531 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73e3b3d1-b670-44ad-bc68-f010ab608e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.079251 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73e3b3d1-b670-44ad-bc68-f010ab608e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.079708 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73e3b3d1-b670-44ad-bc68-f010ab608e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.080136 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73e3b3d1-b670-44ad-bc68-f010ab608e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.102604 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-73e3b3d1-b670-44ad-bc68-f010ab608e03 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/ips" status: 200 len: 153 microversion: 2.20 time: 0.198678 Sep 18 01:01:21.103188 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 346/687] 10.222.0.33 () {60 vars in 1289 bytes} [Sun Sep 18 01:01:20 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/ips => generated 153 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 18 01:01:21.420972 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:21.421522 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:21.428547 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.429035 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.429472 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.430160 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.430619 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.431080 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.444207 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] HTTP exception thrown: Instance 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 could not be found. Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Request method failure captured: Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 HTTP/1.1 Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy31mVmknuEEFVFaU-1XS-k0H1_yKxD0sx28JFsSSlFMJsEGR28zy2XJpRMQQN1x9OLqPLv25JxF5nxicUtHMc-A7k80RvI3QkvK9qwQ0XmK7UZaXL5gu4ruu-xgYOgeYvpm0dpbuXBtjB2YPKKLVqNnntObPsdpKJX6vJQT6ziakM Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: 8cbf74b218c04911bb921f7cc2c6e966 Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:01:21.445838 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8cbf74b218c04911bb921f7cc2c6e966"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8cbf74b218c04911bb921f7cc2c6e966"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8cbf74b218c04911bb921f7cc2c6e966", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8cbf74b218c04911bb921f7cc2c6e966"}]}] Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: 8cbf74b218c04911bb921f7cc2c6e966 Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-ServerRescueNegativeTestJSON-233879556-project Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 4d84f31e15924d3c8dbd7aac8a0f3576 Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-ServerRescueNegativeTestJSON-233879556-project Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 could not be found. Sep 18 01:01:21.447680 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728'} Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 could not be found. Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:21.448565 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 could not be found. Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 could not be found. Sep 18 01:01:21.449960 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:21.451886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Returning 404 to user: Instance 77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:21.451886 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b15838db-098b-45b2-b175-df833bdd98c3 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728" status: 404 len: 111 microversion: 2.1 time: 0.030153 Sep 18 01:01:21.451886 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 342/688] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:21 2022] GET /compute/v2.1/servers/77b2c1db-b85b-43e2-b6ff-bcd8e7bd9728 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:21.455698 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7bc82e0e-9ebf-462f-b853-cc798d0bcaef tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:21.456198 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7bc82e0e-9ebf-462f-b853-cc798d0bcaef tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:21.462852 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bc82e0e-9ebf-462f-b853-cc798d0bcaef tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.463351 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bc82e0e-9ebf-462f-b853-cc798d0bcaef tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.463792 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bc82e0e-9ebf-462f-b853-cc798d0bcaef tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.464491 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bc82e0e-9ebf-462f-b853-cc798d0bcaef tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.464953 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bc82e0e-9ebf-462f-b853-cc798d0bcaef tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.465379 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7bc82e0e-9ebf-462f-b853-cc798d0bcaef tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.492929 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7bc82e0e-9ebf-462f-b853-cc798d0bcaef tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Going to try to terminate instance {{(pid=120687) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:01:21.507557 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b54150d2-9ecd-46f7-b0b2-77be8fa1a6c6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:21.508180 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b54150d2-9ecd-46f7-b0b2-77be8fa1a6c6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:21.514070 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b54150d2-9ecd-46f7-b0b2-77be8fa1a6c6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.514560 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b54150d2-9ecd-46f7-b0b2-77be8fa1a6c6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.515048 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b54150d2-9ecd-46f7-b0b2-77be8fa1a6c6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.515756 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b54150d2-9ecd-46f7-b0b2-77be8fa1a6c6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.516292 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b54150d2-9ecd-46f7-b0b2-77be8fa1a6c6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.516930 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b54150d2-9ecd-46f7-b0b2-77be8fa1a6c6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.572558 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7bc82e0e-9ebf-462f-b853-cc798d0bcaef tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 204 len: 0 microversion: 2.1 time: 0.120092 Sep 18 01:01:21.573510 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 343/689] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:21 2022] DELETE /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:21.583547 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7a99e870-a60c-42f0-b58d-96b10d0781dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:21.584246 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7a99e870-a60c-42f0-b58d-96b10d0781dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:21.590296 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a99e870-a60c-42f0-b58d-96b10d0781dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.590891 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a99e870-a60c-42f0-b58d-96b10d0781dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.591392 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a99e870-a60c-42f0-b58d-96b10d0781dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.592152 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a99e870-a60c-42f0-b58d-96b10d0781dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:21.592697 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a99e870-a60c-42f0-b58d-96b10d0781dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:21.593189 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7a99e870-a60c-42f0-b58d-96b10d0781dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:21.693107 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-b54150d2-9ecd-46f7-b0b2-77be8fa1a6c6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:21.702117 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b54150d2-9ecd-46f7-b0b2-77be8fa1a6c6 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1366 microversion: 2.1 time: 0.258597 Sep 18 01:01:21.702705 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 347/690] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:21 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:21.749719 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7a99e870-a60c-42f0-b58d-96b10d0781dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:21.757805 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7a99e870-a60c-42f0-b58d-96b10d0781dc tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.179551 Sep 18 01:01:21.758368 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 344/691] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:21 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:22.725788 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-87c69e2b-a444-4466-b42f-4ee73b78070b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:22.726315 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-87c69e2b-a444-4466-b42f-4ee73b78070b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:22.733009 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87c69e2b-a444-4466-b42f-4ee73b78070b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:22.733496 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87c69e2b-a444-4466-b42f-4ee73b78070b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:22.733966 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87c69e2b-a444-4466-b42f-4ee73b78070b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:22.735187 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87c69e2b-a444-4466-b42f-4ee73b78070b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:22.735650 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87c69e2b-a444-4466-b42f-4ee73b78070b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:22.736111 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-87c69e2b-a444-4466-b42f-4ee73b78070b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:22.780786 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f65b16f8-5cb8-431a-9cf2-4729192b4c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:22.781897 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f65b16f8-5cb8-431a-9cf2-4729192b4c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:22.788245 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f65b16f8-5cb8-431a-9cf2-4729192b4c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:22.788742 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f65b16f8-5cb8-431a-9cf2-4729192b4c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:22.789181 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f65b16f8-5cb8-431a-9cf2-4729192b4c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:22.789886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f65b16f8-5cb8-431a-9cf2-4729192b4c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:22.790346 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f65b16f8-5cb8-431a-9cf2-4729192b4c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:22.790778 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f65b16f8-5cb8-431a-9cf2-4729192b4c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:22.902168 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-87c69e2b-a444-4466-b42f-4ee73b78070b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:22.911238 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-87c69e2b-a444-4466-b42f-4ee73b78070b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1366 microversion: 2.1 time: 0.189157 Sep 18 01:01:22.911821 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 348/692] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:22 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:22.950872 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f65b16f8-5cb8-431a-9cf2-4729192b4c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:22.959355 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f65b16f8-5cb8-431a-9cf2-4729192b4c97 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.182378 Sep 18 01:01:22.959921 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 345/693] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:22 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:23.836473 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-000c3e26-67aa-4850-a0a7-cb27eb52ea54 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:23.837056 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-000c3e26-67aa-4850-a0a7-cb27eb52ea54 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:23.839120 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:23.844804 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-000c3e26-67aa-4850-a0a7-cb27eb52ea54 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:23.845286 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-000c3e26-67aa-4850-a0a7-cb27eb52ea54 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:23.845715 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-000c3e26-67aa-4850-a0a7-cb27eb52ea54 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:23.846405 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-000c3e26-67aa-4850-a0a7-cb27eb52ea54 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:23.846941 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-000c3e26-67aa-4850-a0a7-cb27eb52ea54 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:23.847363 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-000c3e26-67aa-4850-a0a7-cb27eb52ea54 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:23.870686 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-000c3e26-67aa-4850-a0a7-cb27eb52ea54 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lazy-loading 'flavor' on Instance uuid 6f4bab30-d9b2-4713-ab65-46a4754f8153 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:23.935315 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1ab273aa-98a1-4fdc-8b5c-d0807cb3be23 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:23.936581 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1ab273aa-98a1-4fdc-8b5c-d0807cb3be23 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:23.940544 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:23.942105 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=10 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:23.947369 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ab273aa-98a1-4fdc-8b5c-d0807cb3be23 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:23.948118 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ab273aa-98a1-4fdc-8b5c-d0807cb3be23 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:23.948780 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ab273aa-98a1-4fdc-8b5c-d0807cb3be23 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:23.949687 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ab273aa-98a1-4fdc-8b5c-d0807cb3be23 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:23.950405 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ab273aa-98a1-4fdc-8b5c-d0807cb3be23 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:23.951086 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ab273aa-98a1-4fdc-8b5c-d0807cb3be23 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:24.083843 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-000c3e26-67aa-4850-a0a7-cb27eb52ea54 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "POST /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/action" status: 202 len: 0 microversion: 2.20 time: 0.250948 Sep 18 01:01:24.084527 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 349/694] 10.222.0.33 () {62 vars in 1319 bytes} [Sun Sep 18 01:01:23 2022] POST /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 18 01:01:24.132181 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1ab273aa-98a1-4fdc-8b5c-d0807cb3be23 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:24.136208 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:24.144874 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1ab273aa-98a1-4fdc-8b5c-d0807cb3be23 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1366 microversion: 2.1 time: 0.214236 Sep 18 01:01:24.145497 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 346/695] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:23 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:24.149817 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-15b5bb2d-2070-4e5b-bd26-7154afe79b1e req-9e9f3596-9bd2-43a7-bb8a-c715c410c244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc449a97-775f-4dad-8aa1-e12326cfdc88", "name": "network-vif-plugged", "status": "completed", "tag": "5716e21d-3ed3-4b50-ba82-2ad48f1eb0c2"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:24.159631 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-15b5bb2d-2070-4e5b-bd26-7154afe79b1e req-9e9f3596-9bd2-43a7-bb8a-c715c410c244 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:24.160110 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-15b5bb2d-2070-4e5b-bd26-7154afe79b1e req-9e9f3596-9bd2-43a7-bb8a-c715c410c244 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:24.160833 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-15b5bb2d-2070-4e5b-bd26-7154afe79b1e req-9e9f3596-9bd2-43a7-bb8a-c715c410c244 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:24.172698 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-15b5bb2d-2070-4e5b-bd26-7154afe79b1e req-9e9f3596-9bd2-43a7-bb8a-c715c410c244 service nova] Creating event network-vif-plugged:5716e21d-3ed3-4b50-ba82-2ad48f1eb0c2 for instance dc449a97-775f-4dad-8aa1-e12326cfdc88 on hv-cinder-maste Sep 18 01:01:24.177909 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-15b5bb2d-2070-4e5b-bd26-7154afe79b1e req-9e9f3596-9bd2-43a7-bb8a-c715c410c244 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031312 Sep 18 01:01:24.178505 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 347/696] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:24.183432 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:24.184241 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:24.191093 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:24.191580 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:24.192015 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:24.192708 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:24.193165 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:24.193588 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:24.203798 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9c61fa96-7b60-4e39-913f-0737851ab2e6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:24.204535 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9c61fa96-7b60-4e39-913f-0737851ab2e6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:24.211026 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9c61fa96-7b60-4e39-913f-0737851ab2e6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:24.211581 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9c61fa96-7b60-4e39-913f-0737851ab2e6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:24.212104 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9c61fa96-7b60-4e39-913f-0737851ab2e6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:24.212866 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9c61fa96-7b60-4e39-913f-0737851ab2e6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:24.213384 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9c61fa96-7b60-4e39-913f-0737851ab2e6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:24.213871 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9c61fa96-7b60-4e39-913f-0737851ab2e6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:24.391961 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:24.395949 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9c61fa96-7b60-4e39-913f-0737851ab2e6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:24.400239 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:24.401709 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:24.403229 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-bdf8d303-c04a-4b2c-bcd1-262b74fb067a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.223616 Sep 18 01:01:24.403751 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9c61fa96-7b60-4e39-913f-0737851ab2e6 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.317471 Sep 18 01:01:24.403873 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 348/697] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:24 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:24.404319 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 350/698] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:24 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:25.168340 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-ef7bc319-6c1e-4333-a28c-691c021a1503 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:25.168984 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-ef7bc319-6c1e-4333-a28c-691c021a1503 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:25.176064 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ef7bc319-6c1e-4333-a28c-691c021a1503 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.176552 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ef7bc319-6c1e-4333-a28c-691c021a1503 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.177000 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ef7bc319-6c1e-4333-a28c-691c021a1503 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.177695 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ef7bc319-6c1e-4333-a28c-691c021a1503 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.178159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ef7bc319-6c1e-4333-a28c-691c021a1503 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.178588 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-ef7bc319-6c1e-4333-a28c-691c021a1503 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.306156 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-ef7bc319-6c1e-4333-a28c-691c021a1503 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:25.314750 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-ef7bc319-6c1e-4333-a28c-691c021a1503 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1366 microversion: 2.1 time: 0.150348 Sep 18 01:01:25.315351 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 349/699] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:25 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:25.427280 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-77a6b19e-dc53-4c63-8c07-a45f549fcda5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:25.427889 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-77a6b19e-dc53-4c63-8c07-a45f549fcda5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:25.428787 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:25.429430 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:25.434433 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a6b19e-dc53-4c63-8c07-a45f549fcda5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.434968 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a6b19e-dc53-4c63-8c07-a45f549fcda5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.435342 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.435467 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a6b19e-dc53-4c63-8c07-a45f549fcda5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.435833 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.436101 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a6b19e-dc53-4c63-8c07-a45f549fcda5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.436266 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.436560 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a6b19e-dc53-4c63-8c07-a45f549fcda5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.436955 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:25.437056 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77a6b19e-dc53-4c63-8c07-a45f549fcda5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.437441 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:25.438429 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:25.636728 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-77a6b19e-dc53-4c63-8c07-a45f549fcda5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:25.640133 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:25.648150 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-77a6b19e-dc53-4c63-8c07-a45f549fcda5 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.224584 Sep 18 01:01:25.649506 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 351/700] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:25 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:25.650480 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:25.651989 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:25.653168 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f75851b8-d13d-44e7-a29b-27fc946133b6 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.228152 Sep 18 01:01:25.663288 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 350/701] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:25 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:01:26.098251 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-06f42e02-9920-409c-ae3e-e315da0f6da4 req-2a24a1ea-ebcb-4516-b24b-89f120f1f601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf75d794-7c36-40e0-a103-db749b9dd1e2", "name": "network-vif-deleted", "tag": "f9535f32-8846-4f66-9b5c-30fb801b7fbc"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:26.107526 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-06f42e02-9920-409c-ae3e-e315da0f6da4 req-2a24a1ea-ebcb-4516-b24b-89f120f1f601 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.108006 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-06f42e02-9920-409c-ae3e-e315da0f6da4 req-2a24a1ea-ebcb-4516-b24b-89f120f1f601 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.108618 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-06f42e02-9920-409c-ae3e-e315da0f6da4 req-2a24a1ea-ebcb-4516-b24b-89f120f1f601 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.122489 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-06f42e02-9920-409c-ae3e-e315da0f6da4 req-2a24a1ea-ebcb-4516-b24b-89f120f1f601 service nova] Creating event network-vif-deleted:f9535f32-8846-4f66-9b5c-30fb801b7fbc for instance bf75d794-7c36-40e0-a103-db749b9dd1e2 on hv-cinder-maste Sep 18 01:01:26.128322 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-06f42e02-9920-409c-ae3e-e315da0f6da4 req-2a24a1ea-ebcb-4516-b24b-89f120f1f601 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034378 Sep 18 01:01:26.128907 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 352/702] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:26.337343 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-90163f99-81fa-447c-a9b5-4c6dcac4e70b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:26.337958 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-90163f99-81fa-447c-a9b5-4c6dcac4e70b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:26.344570 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90163f99-81fa-447c-a9b5-4c6dcac4e70b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.345055 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90163f99-81fa-447c-a9b5-4c6dcac4e70b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.345493 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90163f99-81fa-447c-a9b5-4c6dcac4e70b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.346181 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90163f99-81fa-447c-a9b5-4c6dcac4e70b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.346637 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90163f99-81fa-447c-a9b5-4c6dcac4e70b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.347099 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-90163f99-81fa-447c-a9b5-4c6dcac4e70b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.481573 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-90163f99-81fa-447c-a9b5-4c6dcac4e70b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:26.490323 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-90163f99-81fa-447c-a9b5-4c6dcac4e70b tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1366 microversion: 2.1 time: 0.156677 Sep 18 01:01:26.491229 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 351/703] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:26 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:26.674640 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:26.675298 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:26.679350 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:26.679962 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:26.681564 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.682063 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.682546 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.683281 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.683745 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.684174 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.686255 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.687028 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.688383 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.689993 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.689993 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.690500 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.719251 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:26.719865 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:26.720318 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:26.720792 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lazy-loading 'fault' on Instance uuid bf75d794-7c36-40e0-a103-db749b9dd1e2 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:26.787267 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:26.795753 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c5ae0bdd-bb21-4be3-a686-55d82e2b495b tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1312 microversion: 2.1 time: 0.126786 Sep 18 01:01:26.796335 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 353/704] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:26 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1312 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:26.852673 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:26.861703 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:26.863147 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:26.864293 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a1b9a2be-0094-42c7-bd83-b03388bd0857 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.189007 Sep 18 01:01:26.864848 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 352/705] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:26 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:01:27.513673 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-eea21b3c-87ec-4d97-a650-9b31351f0fff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:27.514275 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-eea21b3c-87ec-4d97-a650-9b31351f0fff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:27.520275 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eea21b3c-87ec-4d97-a650-9b31351f0fff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.520768 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eea21b3c-87ec-4d97-a650-9b31351f0fff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.521203 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eea21b3c-87ec-4d97-a650-9b31351f0fff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.521882 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eea21b3c-87ec-4d97-a650-9b31351f0fff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.522331 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eea21b3c-87ec-4d97-a650-9b31351f0fff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.522750 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eea21b3c-87ec-4d97-a650-9b31351f0fff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.526868 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:27.653640 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-eea21b3c-87ec-4d97-a650-9b31351f0fff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:27.662149 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-eea21b3c-87ec-4d97-a650-9b31351f0fff tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1555 microversion: 2.1 time: 0.152598 Sep 18 01:01:27.662715 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 354/706] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:27 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:27.684038 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-6cc3e93a-426a-4a3e-abfb-b60362bd36b0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:27.684548 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-6cc3e93a-426a-4a3e-abfb-b60362bd36b0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:27.691575 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cc3e93a-426a-4a3e-abfb-b60362bd36b0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.692064 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cc3e93a-426a-4a3e-abfb-b60362bd36b0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.692503 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cc3e93a-426a-4a3e-abfb-b60362bd36b0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.693227 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cc3e93a-426a-4a3e-abfb-b60362bd36b0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.693684 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cc3e93a-426a-4a3e-abfb-b60362bd36b0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.694111 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cc3e93a-426a-4a3e-abfb-b60362bd36b0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.774746 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-6cc3e93a-426a-4a3e-abfb-b60362bd36b0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094546 Sep 18 01:01:27.775379 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 353/707] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 18 01:01:27 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:27.819606 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:27.820221 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:27.826827 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.827325 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.827754 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.829061 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.829546 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.829974 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.868647 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.869137 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.869571 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.870022 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lazy-loading 'fault' on Instance uuid bf75d794-7c36-40e0-a103-db749b9dd1e2 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:27.889473 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:27.890218 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:27.898199 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.898680 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.899148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.899859 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:27.900522 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:27.900992 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:27.926428 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d84f31e15924d3c8dbd7aac8a0f3576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbf74b218c04911bb921f7cc2c6e966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:27.934712 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-86958a71-48e5-4cda-8e11-d14c3a1c9895 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 200 len: 1312 microversion: 2.1 time: 0.118804 Sep 18 01:01:27.935341 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 355/708] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:27 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:28.144074 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:28.152301 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:28.153735 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:28.154918 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c19d87db-8912-4aa8-92ad-c66cfc63b29a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.269304 Sep 18 01:01:28.155488 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 354/709] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:27 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:01:28.957693 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:28.958370 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] [instance: bf75d794-7c36-40e0-a103-db749b9dd1e2] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:28.965002 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:28.965502 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:28.965933 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:28.966888 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:28.967599 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:28.968240 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:28.982751 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] HTTP exception thrown: Instance bf75d794-7c36-40e0-a103-db749b9dd1e2 could not be found. Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Request method failure captured: Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 HTTP/1.1 Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmy31mVmknuEEFVFaU-1XS-k0H1_yKxD0sx28JFsSSlFMJsEGR28zy2XJpRMQQN1x9OLqPLv25JxF5nxicUtHMc-A7k80RvI3QkvK9qwQ0XmK7UZaXL5gu4ruu-xgYOgeYvpm0dpbuXBtjB2YPKKLVqNnntObPsdpKJX6vJQT6ziakM Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 8cbf74b218c04911bb921f7cc2c6e966 Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:01:28.985121 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8cbf74b218c04911bb921f7cc2c6e966"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8cbf74b218c04911bb921f7cc2c6e966"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8cbf74b218c04911bb921f7cc2c6e966", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8cbf74b218c04911bb921f7cc2c6e966"}]}] Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 8cbf74b218c04911bb921f7cc2c6e966 Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-233879556 Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-ServerRescueNegativeTestJSON-233879556-project Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 4d84f31e15924d3c8dbd7aac8a0f3576 Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-ServerRescueNegativeTestJSON-233879556-project Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance bf75d794-7c36-40e0-a103-db749b9dd1e2 could not be found. Sep 18 01:01:28.986864 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'bf75d794-7c36-40e0-a103-db749b9dd1e2'} Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf75d794-7c36-40e0-a103-db749b9dd1e2 could not be found. Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:28.987793 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf75d794-7c36-40e0-a103-db749b9dd1e2 could not be found. Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf75d794-7c36-40e0-a103-db749b9dd1e2 could not be found. Sep 18 01:01:28.989368 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:28.990758 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] Returning 404 to user: Instance bf75d794-7c36-40e0-a103-db749b9dd1e2 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:28.990758 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-088045b4-d110-4034-8d87-693855854f85 tempest-ServerRescueNegativeTestJSON-233879556 tempest-ServerRescueNegativeTestJSON-233879556-project] 10.222.0.33 "GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2" status: 404 len: 111 microversion: 2.1 time: 0.033094 Sep 18 01:01:28.991019 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 356/710] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:28 2022] GET /compute/v2.1/servers/bf75d794-7c36-40e0-a103-db749b9dd1e2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:29.023525 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-e8e0870e-644b-4894-8712-82a7368cc174 req-52cf02d4-3dcc-4340-8596-25a44833109a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc449a97-775f-4dad-8aa1-e12326cfdc88", "tag": "5716e21d-3ed3-4b50-ba82-2ad48f1eb0c2"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:29.034880 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-e8e0870e-644b-4894-8712-82a7368cc174 req-52cf02d4-3dcc-4340-8596-25a44833109a service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:29.035778 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-e8e0870e-644b-4894-8712-82a7368cc174 req-52cf02d4-3dcc-4340-8596-25a44833109a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:29.036218 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-e8e0870e-644b-4894-8712-82a7368cc174 req-52cf02d4-3dcc-4340-8596-25a44833109a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:29.050096 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-e8e0870e-644b-4894-8712-82a7368cc174 req-52cf02d4-3dcc-4340-8596-25a44833109a service nova] Creating event network-changed:5716e21d-3ed3-4b50-ba82-2ad48f1eb0c2 for instance dc449a97-775f-4dad-8aa1-e12326cfdc88 on hv-cinder-maste Sep 18 01:01:29.056070 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-e8e0870e-644b-4894-8712-82a7368cc174 req-52cf02d4-3dcc-4340-8596-25a44833109a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035300 Sep 18 01:01:29.057016 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 355/711] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:29.180264 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:29.180868 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:29.186982 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:29.187970 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:29.188462 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:29.189202 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:29.189792 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:29.190293 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:29.330828 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:29.340142 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:29.342080 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:29.343471 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-93df5646-670c-4c80-9938-9041fcab3012 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.167065 Sep 18 01:01:29.344662 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 357/712] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:29 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:30.370870 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:30.371463 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:30.377813 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:30.378311 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:30.378750 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:30.379472 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:30.380341 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:30.380341 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:30.515308 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:30.524002 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:30.525458 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:30.526619 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9e523a10-088b-4e4c-ba30-c5d303e80580 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.160884 Sep 18 01:01:30.527209 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 356/713] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:30 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:31.554202 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:31.555007 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:31.563780 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:31.564485 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:31.564996 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:31.566293 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:31.567012 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:31.567670 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:31.704150 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:31.713757 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:31.716259 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:31.718330 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7967e64c-3824-4224-a807-37b1eee33ab5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.168410 Sep 18 01:01:31.720560 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 358/714] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:31 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:32.752849 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:32.753447 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:32.760702 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:32.761668 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:32.762740 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:32.767252 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:32.767901 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:32.769923 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:32.923877 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:32.944401 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:32.945907 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:32.950522 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-74a72427-5f40-447c-b0a7-990cde45db41 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.199631 Sep 18 01:01:32.957345 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 357/715] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:32 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:33.976335 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:33.976935 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:33.983731 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:33.984385 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:33.985087 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:33.985814 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:33.986269 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:33.986692 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:34.130809 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:34.139007 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:34.141456 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:34.142662 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d5b1590f-266e-4b53-933b-58bab3330ca8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.170547 Sep 18 01:01:34.143277 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 359/716] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:33 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:34.269259 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0fb0bb1f-aca1-4622-93f1-f47f8371212e tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Action: 'create', calling method: .version_select at 0x7f56729e39d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-787568379"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:34.555698 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0fb0bb1f-aca1-4622-93f1-f47f8371212e tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.400843 Sep 18 01:01:34.556397 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 358/717] 10.222.0.33 () {60 vars in 1155 bytes} [Sun Sep 18 01:01:34 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 402 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 18 01:01:34.569992 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a7b540df-e011-4022-bc05-1ea1d09dad49 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f5672a1d790>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:34.622429 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a7b540df-e011-4022-bc05-1ea1d09dad49 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc" status: 200 len: 344 microversion: 2.1 time: 0.056298 Sep 18 01:01:34.623046 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 360/718] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 01:01:34 2022] GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:35.168420 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:35.169033 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:35.176208 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:35.176697 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:35.177141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:35.177866 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:35.178328 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:35.178759 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:35.303963 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:35.312676 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:35.314114 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:35.315297 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5cfee8ea-648c-43ea-a5fb-7649174f9be3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.151304 Sep 18 01:01:35.315854 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 359/719] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:35 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:35.638405 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-bc87e03c-fb9f-4c8a-bd7f-19ec4011473a tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f56729b8670>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:35.685237 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-bc87e03c-fb9f-4c8a-bd7f-19ec4011473a tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc" status: 200 len: 345 microversion: 2.1 time: 0.051167 Sep 18 01:01:35.685822 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 361/720] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 01:01:35 2022] GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:35.698816 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b994994f-2118-4a50-a1a4-6e6e47ee3418 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Action: 'create', calling method: .version_select at 0x7f5672a019d0>, body: {"snapshot": {"volume_id": "2ebce4bc-4db3-4e45-9423-93dde95376dc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-735896062"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:35.847774 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b994994f-2118-4a50-a1a4-6e6e47ee3418 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.152690 Sep 18 01:01:35.848480 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 360/721] 10.222.0.33 () {60 vars in 1162 bytes} [Sun Sep 18 01:01:35 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:35.861837 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7bd8a57e-1fed-4631-971b-a1634b895f2e tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f56729b8e50>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:35.894356 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7bd8a57e-1fed-4631-971b-a1634b895f2e tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356" status: 200 len: 286 microversion: 2.1 time: 0.037340 Sep 18 01:01:35.894947 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 362/722] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 18 01:01:35 2022] GET /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:35.907296 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4f97e239-100c-4939-ac3b-0ff52d185b0f tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f5672bf0550>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:35.937732 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4f97e239-100c-4939-ac3b-0ff52d185b0f tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034925 Sep 18 01:01:35.938294 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 361/723] 10.222.0.33 () {58 vars in 1140 bytes} [Sun Sep 18 01:01:35 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:35.949213 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-687c595f-d253-4197-b5ce-1b05fb09a084 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f56729b8820>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:35.980645 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-687c595f-d253-4197-b5ce-1b05fb09a084 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356" status: 200 len: 286 microversion: 2.1 time: 0.035061 Sep 18 01:01:35.981269 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 363/724] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 18 01:01:35 2022] GET /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:36.342901 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:36.343673 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:36.349720 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:36.350212 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:36.350649 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:36.351373 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:36.351836 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:36.352267 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:36.487207 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:36.495542 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:36.497045 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:36.498200 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-25e5831c-c2bc-4e78-bfc6-c1fb4afc33e7 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1746 microversion: 2.20 time: 0.160558 Sep 18 01:01:36.498755 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 362/725] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:36 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:36.994243 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d3e0966b-73d4-4fcf-9880-788f47be1bfa tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f567298c9d0>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:37.024409 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d3e0966b-73d4-4fcf-9880-788f47be1bfa tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356" status: 200 len: 287 microversion: 2.1 time: 0.034753 Sep 18 01:01:37.025023 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 364/726] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 18 01:01:36 2022] GET /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:37.036571 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-49407b74-06fe-4ae4-ba20-c40b016547f1 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f5672a01d30>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:37.092485 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-49407b74-06fe-4ae4-ba20-c40b016547f1 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356" status: 202 len: 0 microversion: 2.1 time: 0.059646 Sep 18 01:01:37.093598 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 363/727] 10.222.0.33 () {58 vars in 1254 bytes} [Sun Sep 18 01:01:37 2022] DELETE /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:37.101799 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-cbf62263-9882-4277-95fe-47df9095d6eb tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f5672a73ee0>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:37.131598 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-cbf62263-9882-4277-95fe-47df9095d6eb tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356" status: 200 len: 286 microversion: 2.1 time: 0.033612 Sep 18 01:01:37.132168 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 365/728] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 18 01:01:37 2022] GET /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:37.525377 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:37.526007 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:37.533017 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:37.533520 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:37.533950 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:37.534635 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:37.535116 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:37.535537 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:37.662236 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:37.670234 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:37.672010 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:37.673165 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f3771a4b-6c1d-4277-9721-131b70ed82f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1746 microversion: 2.20 time: 0.152156 Sep 18 01:01:37.673722 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 364/729] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:37 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:38.145830 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7f169eb6-0277-45b7-a3c0-41410359b565 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f5672aa9b80>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:38.173344 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-7f169eb6-0277-45b7-a3c0-41410359b565 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] HTTP exception thrown: Snapshot 1e507310-5334-46c6-9c50-b764a61ff356 could not be found. Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7f169eb6-0277-45b7-a3c0-41410359b565 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Request method failure captured: Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356 HTTP/1.1 Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJm3u6FBA0na8WMw_DsPAZ36_ZpU0n4hqPGR-kBBoH9j81w4AH4s_NigifZbkzPdHmK40c8ItiCB76HlK6NkdS_222jkWf8lexDEYF1k3s-lKLbq7wJ3SQPvnCvs0UqMHGcsDG0b3R-Zo1feKOj5oeMutkW0cnbRr6KpbX5gY0nzLZAs Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 991ba3230c644658a725dd2ac61aaefb Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:01:38.175588 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/991ba3230c644658a725dd2ac61aaefb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/991ba3230c644658a725dd2ac61aaefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_991ba3230c644658a725dd2ac61aaefb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/991ba3230c644658a725dd2ac61aaefb"}]}] Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 991ba3230c644658a725dd2ac61aaefb Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-VolumesSnapshotsTestJSON-732337329-project Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 35be9841f04648c5aea8efd5eacab30c Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-VolumesSnapshotsTestJSON-732337329-project Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Snapshot 1e507310-5334-46c6-9c50-b764a61ff356 could not be found. Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '1e507310-5334-46c6-9c50-b764a61ff356'} Sep 18 01:01:38.177243 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1e507310-5334-46c6-9c50-b764a61ff356 could not be found. (HTTP 404) (Request-ID: req-c9e10886-2560-4610-be1e-5b8c77d18f66) Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:38.178471 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:01:38.179894 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1e507310-5334-46c6-9c50-b764a61ff356 could not be found. Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 18 01:01:38.181669 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1e507310-5334-46c6-9c50-b764a61ff356 could not be found. Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1e507310-5334-46c6-9c50-b764a61ff356 could not be found. Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7f169eb6-0277-45b7-a3c0-41410359b565 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Returning 404 to user: Snapshot 1e507310-5334-46c6-9c50-b764a61ff356 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7f169eb6-0277-45b7-a3c0-41410359b565 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356" status: 404 len: 111 microversion: 2.1 time: 0.035973 Sep 18 01:01:38.183242 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 366/730] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 18 01:01:38 2022] GET /compute/v2.1/os-snapshots/1e507310-5334-46c6-9c50-b764a61ff356 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:38.185897 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-037c4cbf-fd50-41bf-9040-8fc8cc803b06 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f5672a1aca0>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:38.253209 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-037c4cbf-fd50-41bf-9040-8fc8cc803b06 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc" status: 202 len: 0 microversion: 2.1 time: 0.071010 Sep 18 01:01:38.253779 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 365/731] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 18 01:01:38 2022] DELETE /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:38.262032 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-71578da5-55c6-4ff4-9b09-5cc6919b82ed tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f56729de940>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:38.331154 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-71578da5-55c6-4ff4-9b09-5cc6919b82ed tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc" status: 200 len: 344 microversion: 2.1 time: 0.073012 Sep 18 01:01:38.339545 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 367/732] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 01:01:38 2022] GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc => generated 344 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:38.698085 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:38.698705 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:38.705266 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.705875 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.706196 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.706930 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:38.707396 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:38.707827 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:38.846404 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:38.855565 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:38.857247 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:38.859160 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-51327de8-6359-4a98-b9f8-57eddc56f5c9 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1741 microversion: 2.20 time: 0.165383 Sep 18 01:01:38.860373 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 366/733] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:38 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:39.349263 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-65518627-fc33-4a9c-afcd-9a702f72b10f tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f56729b84c0>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:39.383255 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-65518627-fc33-4a9c-afcd-9a702f72b10f tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] HTTP exception thrown: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-65518627-fc33-4a9c-afcd-9a702f72b10f tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Request method failure captured: Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc HTTP/1.1 Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJm3u6FBA0na8WMw_DsPAZ36_ZpU0n4hqPGR-kBBoH9j81w4AH4s_NigifZbkzPdHmK40c8ItiCB76HlK6NkdS_222jkWf8lexDEYF1k3s-lKLbq7wJ3SQPvnCvs0UqMHGcsDG0b3R-Zo1feKOj5oeMutkW0cnbRr6KpbX5gY0nzLZAs Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 991ba3230c644658a725dd2ac61aaefb Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:01:39.385766 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/991ba3230c644658a725dd2ac61aaefb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/991ba3230c644658a725dd2ac61aaefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_991ba3230c644658a725dd2ac61aaefb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/991ba3230c644658a725dd2ac61aaefb"}]}] Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 991ba3230c644658a725dd2ac61aaefb Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-VolumesSnapshotsTestJSON-732337329-project Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 35be9841f04648c5aea8efd5eacab30c Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-VolumesSnapshotsTestJSON-732337329-project Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '2ebce4bc-4db3-4e45-9423-93dde95376dc'} Sep 18 01:01:39.387476 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. (HTTP 404) (Request-ID: req-f083e686-4a84-4804-8496-e248bcb108de) Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:39.388444 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:01:39.390533 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 18 01:01:39.392063 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:39.393661 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.393661 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.393661 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:39.393661 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.393661 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.393661 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:39.393661 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:39.393661 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:39.393661 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:39.393661 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.393661 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.395390 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-65518627-fc33-4a9c-afcd-9a702f72b10f tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Returning 404 to user: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:39.396255 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-65518627-fc33-4a9c-afcd-9a702f72b10f tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc" status: 404 len: 109 microversion: 2.1 time: 0.052631 Sep 18 01:01:39.396811 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 368/734] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 01:01:39 2022] GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:39.413151 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8b5b3d45-dfdc-4925-8f32-c4e9345b8142 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f5672aae550>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:39.450506 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-8b5b3d45-dfdc-4925-8f32-c4e9345b8142 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] HTTP exception thrown: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8b5b3d45-dfdc-4925-8f32-c4e9345b8142 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Request method failure captured: Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: DELETE /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc HTTP/1.1 Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJm3u6FBA0na8WMw_DsPAZ36_ZpU0n4hqPGR-kBBoH9j81w4AH4s_NigifZbkzPdHmK40c8ItiCB76HlK6NkdS_222jkWf8lexDEYF1k3s-lKLbq7wJ3SQPvnCvs0UqMHGcsDG0b3R-Zo1feKOj5oeMutkW0cnbRr6KpbX5gY0nzLZAs Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: 991ba3230c644658a725dd2ac61aaefb Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:01:39.453870 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/991ba3230c644658a725dd2ac61aaefb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/991ba3230c644658a725dd2ac61aaefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_991ba3230c644658a725dd2ac61aaefb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/991ba3230c644658a725dd2ac61aaefb"}]}] Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: 991ba3230c644658a725dd2ac61aaefb Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-VolumesSnapshotsTestJSON-732337329-project Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 35be9841f04648c5aea8efd5eacab30c Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-VolumesSnapshotsTestJSON-732337329-project Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '2ebce4bc-4db3-4e45-9423-93dde95376dc'} Sep 18 01:01:39.455531 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. (HTTP 404) (Request-ID: req-772931cb-3045-47dd-8936-fe15b94f353c) Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:39.456505 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 18 01:01:39.457889 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 18 01:01:39.459301 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8b5b3d45-dfdc-4925-8f32-c4e9345b8142 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Returning 404 to user: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:39.460969 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8b5b3d45-dfdc-4925-8f32-c4e9345b8142 tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc" status: 404 len: 109 microversion: 2.1 time: 0.046005 Sep 18 01:01:39.465114 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c59d8df6-7a60-401f-8f0a-631b0745f52b tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Calling method '.version_select at 0x7f567298ca60>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:39.471297 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 367/735] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 18 01:01:39 2022] DELETE /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:39.505764 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-c59d8df6-7a60-401f-8f0a-631b0745f52b tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] HTTP exception thrown: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c59d8df6-7a60-401f-8f0a-631b0745f52b tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Request method failure captured: Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc HTTP/1.1 Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJm3u6FBA0na8WMw_DsPAZ36_ZpU0n4hqPGR-kBBoH9j81w4AH4s_NigifZbkzPdHmK40c8ItiCB76HlK6NkdS_222jkWf8lexDEYF1k3s-lKLbq7wJ3SQPvnCvs0UqMHGcsDG0b3R-Zo1feKOj5oeMutkW0cnbRr6KpbX5gY0nzLZAs Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 991ba3230c644658a725dd2ac61aaefb Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:01:39.507741 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/991ba3230c644658a725dd2ac61aaefb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/991ba3230c644658a725dd2ac61aaefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_991ba3230c644658a725dd2ac61aaefb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/991ba3230c644658a725dd2ac61aaefb"}]}] Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 991ba3230c644658a725dd2ac61aaefb Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-732337329 Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-VolumesSnapshotsTestJSON-732337329-project Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 35be9841f04648c5aea8efd5eacab30c Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-VolumesSnapshotsTestJSON-732337329-project Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '2ebce4bc-4db3-4e45-9423-93dde95376dc'} Sep 18 01:01:39.509163 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. (HTTP 404) (Request-ID: req-a95b4c7e-bf32-4a4a-83c9-2071518556c4) Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:39.510011 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 18 01:01:39.512572 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 18 01:01:39.514925 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c59d8df6-7a60-401f-8f0a-631b0745f52b tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] Returning 404 to user: Volume 2ebce4bc-4db3-4e45-9423-93dde95376dc could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c59d8df6-7a60-401f-8f0a-631b0745f52b tempest-VolumesSnapshotsTestJSON-732337329 tempest-VolumesSnapshotsTestJSON-732337329-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc" status: 404 len: 109 microversion: 2.1 time: 0.048912 Sep 18 01:01:39.517962 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 369/736] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 01:01:39 2022] GET /compute/v2.1/os-volumes/2ebce4bc-4db3-4e45-9423-93dde95376dc => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:01:39.903177 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:39.903888 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:39.919595 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:39.920421 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:39.921567 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:39.922657 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:39.923206 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:39.923976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:40.135449 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:40.148335 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:40.150175 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:40.152979 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-3cb51e43-be9f-4a5d-b1c8-31bccaf9b2ce tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1741 microversion: 2.20 time: 0.254476 Sep 18 01:01:40.153539 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 368/737] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:39 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1741 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:40.207844 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-0a75ddba-24ab-42c1-bd1d-ea91325a6519 req-3a31221f-db4e-4a05-8a0c-85cf51874d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f4bab30-d9b2-4713-ab65-46a4754f8153", "name": "network-vif-plugged", "status": "completed", "tag": "41948106-b5ee-425d-bfed-b11f6d5cdb7e"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:40.219881 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:40.232917 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-0a75ddba-24ab-42c1-bd1d-ea91325a6519 req-3a31221f-db4e-4a05-8a0c-85cf51874d09 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:40.237664 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-0a75ddba-24ab-42c1-bd1d-ea91325a6519 req-3a31221f-db4e-4a05-8a0c-85cf51874d09 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:40.238142 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-0a75ddba-24ab-42c1-bd1d-ea91325a6519 req-3a31221f-db4e-4a05-8a0c-85cf51874d09 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:40.272612 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-0a75ddba-24ab-42c1-bd1d-ea91325a6519 req-3a31221f-db4e-4a05-8a0c-85cf51874d09 service nova] Creating event network-vif-plugged:41948106-b5ee-425d-bfed-b11f6d5cdb7e for instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 on hv-cinder-maste Sep 18 01:01:40.279771 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-0a75ddba-24ab-42c1-bd1d-ea91325a6519 req-3a31221f-db4e-4a05-8a0c-85cf51874d09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076736 Sep 18 01:01:40.282694 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 370/738] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:41.183417 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:41.184703 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:41.192923 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:41.198327 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:41.199089 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:41.200164 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:41.200821 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:41.201440 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:41.399386 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:41.408981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:41.411423 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:41.412934 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0e2b67f8-c56b-497e-96bb-fe7d61be9eb8 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1741 microversion: 2.20 time: 0.233500 Sep 18 01:01:41.413992 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 369/739] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:41 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:41.934661 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-10113c1c-2289-4e1f-aa68-3bdc475a0b92 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:41.935459 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-10113c1c-2289-4e1f-aa68-3bdc475a0b92 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:41.947472 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-10113c1c-2289-4e1f-aa68-3bdc475a0b92 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:41.949439 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-10113c1c-2289-4e1f-aa68-3bdc475a0b92 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:41.949957 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-10113c1c-2289-4e1f-aa68-3bdc475a0b92 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:41.950748 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-10113c1c-2289-4e1f-aa68-3bdc475a0b92 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:41.951459 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-10113c1c-2289-4e1f-aa68-3bdc475a0b92 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:41.952140 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-10113c1c-2289-4e1f-aa68-3bdc475a0b92 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:41.983933 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-10113c1c-2289-4e1f-aa68-3bdc475a0b92 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lazy-loading 'flavor' on Instance uuid 5a39d642-1c36-48cb-909b-751208990b95 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:42.080055 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-10113c1c-2289-4e1f-aa68-3bdc475a0b92 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "POST /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95/action" status: 202 len: 0 microversion: 2.1 time: 0.150504 Sep 18 01:01:42.081414 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 371/740] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 01:01:41 2022] POST /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:42.089511 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d8c9d869-838a-41b2-a17d-1ebd58e97590 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:42.090128 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d8c9d869-838a-41b2-a17d-1ebd58e97590 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:42.102587 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8c9d869-838a-41b2-a17d-1ebd58e97590 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:42.107844 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8c9d869-838a-41b2-a17d-1ebd58e97590 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:42.109575 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8c9d869-838a-41b2-a17d-1ebd58e97590 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:42.114332 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8c9d869-838a-41b2-a17d-1ebd58e97590 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:42.115361 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8c9d869-838a-41b2-a17d-1ebd58e97590 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:42.116182 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d8c9d869-838a-41b2-a17d-1ebd58e97590 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:42.348034 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d8c9d869-838a-41b2-a17d-1ebd58e97590 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:42.356540 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d8c9d869-838a-41b2-a17d-1ebd58e97590 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.270899 Sep 18 01:01:42.358885 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 370/741] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:42 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:42.395626 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-bbcfc233-2f84-43d3-8172-1653de29b946 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:42.396413 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-bbcfc233-2f84-43d3-8172-1653de29b946 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:42.403033 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bbcfc233-2f84-43d3-8172-1653de29b946 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:42.403519 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bbcfc233-2f84-43d3-8172-1653de29b946 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:42.403946 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bbcfc233-2f84-43d3-8172-1653de29b946 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:42.405360 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bbcfc233-2f84-43d3-8172-1653de29b946 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:42.406383 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bbcfc233-2f84-43d3-8172-1653de29b946 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:42.407011 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-bbcfc233-2f84-43d3-8172-1653de29b946 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:42.438976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:42.439636 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:42.442340 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-bbcfc233-2f84-43d3-8172-1653de29b946 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/ips" status: 200 len: 146 microversion: 2.1 time: 0.342450 Sep 18 01:01:42.443046 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 372/742] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 18 01:01:42 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/ips => generated 146 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:01:42.474380 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:42.475196 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:42.475857 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:42.479569 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:42.480070 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:42.480468 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:42.500485 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=100 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:42.727213 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:42.741269 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:42.750752 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:42.754051 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1e3d77f6-ba05-499f-abea-abbf9007643f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1741 microversion: 2.20 time: 0.318554 Sep 18 01:01:42.761627 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 371/743] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:42 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1741 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:01:43.387439 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a827e6e8-0ce0-457c-8820-18286ea05eba tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:43.388967 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-a827e6e8-0ce0-457c-8820-18286ea05eba tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:43.398971 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a827e6e8-0ce0-457c-8820-18286ea05eba tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:43.399949 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a827e6e8-0ce0-457c-8820-18286ea05eba tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:43.400653 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a827e6e8-0ce0-457c-8820-18286ea05eba tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:43.401787 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a827e6e8-0ce0-457c-8820-18286ea05eba tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:43.402312 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a827e6e8-0ce0-457c-8820-18286ea05eba tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:43.402903 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a827e6e8-0ce0-457c-8820-18286ea05eba tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:43.634616 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a827e6e8-0ce0-457c-8820-18286ea05eba tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:43.644357 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a827e6e8-0ce0-457c-8820-18286ea05eba tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.262524 Sep 18 01:01:43.645779 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 373/744] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:43 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:43.782553 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:43.784173 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:43.810650 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:43.811958 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:43.812649 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:43.813531 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:43.814080 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:43.814606 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:44.043762 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-eeede83a-41b8-45bf-90a8-16c3d53d6d62 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb0903cb-5dd0-497a-a378-be4ae66e26e0"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:44.062962 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:44.070947 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-eeede83a-41b8-45bf-90a8-16c3d53d6d62 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:44.094657 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:44.101600 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeede83a-41b8-45bf-90a8-16c3d53d6d62 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:44.102101 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeede83a-41b8-45bf-90a8-16c3d53d6d62 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:44.102725 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeede83a-41b8-45bf-90a8-16c3d53d6d62 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:44.103664 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeede83a-41b8-45bf-90a8-16c3d53d6d62 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:44.104574 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeede83a-41b8-45bf-90a8-16c3d53d6d62 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:44.105354 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeede83a-41b8-45bf-90a8-16c3d53d6d62 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:44.106865 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:44.110759 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c8e6682c-dbdc-4ced-b0f1-99885336cc53 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1741 microversion: 2.20 time: 0.332796 Sep 18 01:01:44.124064 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 372/745] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:43 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1741 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:44.493222 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-eeede83a-41b8-45bf-90a8-16c3d53d6d62 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "POST /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.460375 Sep 18 01:01:44.494196 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 374/746] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 01:01:44 2022] POST /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:01:44.673956 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-bbe64c5c-7e49-4553-bd93-6d1493280061 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:44.674677 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-bbe64c5c-7e49-4553-bd93-6d1493280061 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:44.685568 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bbe64c5c-7e49-4553-bd93-6d1493280061 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:44.696608 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bbe64c5c-7e49-4553-bd93-6d1493280061 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:44.702003 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bbe64c5c-7e49-4553-bd93-6d1493280061 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:44.703643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bbe64c5c-7e49-4553-bd93-6d1493280061 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:44.705764 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bbe64c5c-7e49-4553-bd93-6d1493280061 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:44.706886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-bbe64c5c-7e49-4553-bd93-6d1493280061 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:44.909546 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-bbe64c5c-7e49-4553-bd93-6d1493280061 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:44.919991 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-bbe64c5c-7e49-4553-bd93-6d1493280061 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.253348 Sep 18 01:01:44.920648 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 373/747] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:44 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:45.144893 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:45.146095 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:45.153845 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.155373 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.156450 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.157493 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.158189 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.159247 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.324309 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:45.336954 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:45.338763 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:45.340095 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-281ab817-2c88-4817-a7f1-730dad2cf10d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1741 microversion: 2.20 time: 0.202133 Sep 18 01:01:45.342841 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 375/748] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:45 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:45.949159 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f96ff2b5-2418-471f-a4e1-be6832b5ad78 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:45.950401 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f96ff2b5-2418-471f-a4e1-be6832b5ad78 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:45.959557 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f96ff2b5-2418-471f-a4e1-be6832b5ad78 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.961157 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f96ff2b5-2418-471f-a4e1-be6832b5ad78 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.962225 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f96ff2b5-2418-471f-a4e1-be6832b5ad78 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:45.963478 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f96ff2b5-2418-471f-a4e1-be6832b5ad78 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:45.964145 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f96ff2b5-2418-471f-a4e1-be6832b5ad78 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:45.964664 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f96ff2b5-2418-471f-a4e1-be6832b5ad78 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.180862 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f96ff2b5-2418-471f-a4e1-be6832b5ad78 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:46.190816 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f96ff2b5-2418-471f-a4e1-be6832b5ad78 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.248699 Sep 18 01:01:46.207185 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 374/749] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:45 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:46.370934 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:46.371915 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:46.386406 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.386958 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.387406 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.392787 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.393986 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.393986 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.552633 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:46.566288 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:46.568878 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:46.570102 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-774fbadb-bde1-4c5f-97e5-f49127107385 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1741 microversion: 2.20 time: 0.205851 Sep 18 01:01:46.571634 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 376/750] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:46 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:46.827088 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-16a1dffa-8c70-47b9-96b2-988072ef6638 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:46.830135 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-16a1dffa-8c70-47b9-96b2-988072ef6638 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:46.836685 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16a1dffa-8c70-47b9-96b2-988072ef6638 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.837189 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16a1dffa-8c70-47b9-96b2-988072ef6638 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.837666 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16a1dffa-8c70-47b9-96b2-988072ef6638 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.838552 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16a1dffa-8c70-47b9-96b2-988072ef6638 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.839108 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16a1dffa-8c70-47b9-96b2-988072ef6638 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.839882 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-16a1dffa-8c70-47b9-96b2-988072ef6638 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.873574 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-16a1dffa-8c70-47b9-96b2-988072ef6638 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050323 Sep 18 01:01:46.874712 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 375/751] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:01:46 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:46.886942 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-edd95db7-1a43-417d-820f-c71945100ed4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:46.887595 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-edd95db7-1a43-417d-820f-c71945100ed4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:46.904936 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-edd95db7-1a43-417d-820f-c71945100ed4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.905684 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-edd95db7-1a43-417d-820f-c71945100ed4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.906273 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-edd95db7-1a43-417d-820f-c71945100ed4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.907189 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-edd95db7-1a43-417d-820f-c71945100ed4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:46.907643 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-edd95db7-1a43-417d-820f-c71945100ed4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:46.908062 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-edd95db7-1a43-417d-820f-c71945100ed4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:46.962827 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-edd95db7-1a43-417d-820f-c71945100ed4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments/bb0903cb-5dd0-497a-a378-be4ae66e26e0" status: 200 len: 194 microversion: 2.1 time: 0.079971 Sep 18 01:01:46.963356 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 377/752] 10.222.0.33 () {58 vars in 1413 bytes} [Sun Sep 18 01:01:46 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments/bb0903cb-5dd0-497a-a378-be4ae66e26e0 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:47.215708 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4219440d-ec0d-4349-88a3-7439da3e6339 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:47.216398 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4219440d-ec0d-4349-88a3-7439da3e6339 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:47.223966 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4219440d-ec0d-4349-88a3-7439da3e6339 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:47.224794 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4219440d-ec0d-4349-88a3-7439da3e6339 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:47.225464 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4219440d-ec0d-4349-88a3-7439da3e6339 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:47.226639 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4219440d-ec0d-4349-88a3-7439da3e6339 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:47.227276 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4219440d-ec0d-4349-88a3-7439da3e6339 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:47.227886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4219440d-ec0d-4349-88a3-7439da3e6339 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:47.440076 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-4219440d-ec0d-4349-88a3-7439da3e6339 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:47.448869 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4219440d-ec0d-4349-88a3-7439da3e6339 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.237649 Sep 18 01:01:47.467290 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 376/753] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:47 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:47.598057 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:47.598658 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:47.608648 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:47.610351 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:47.613134 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:47.615237 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:47.617048 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:47.618088 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:47.816724 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:47.821525 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:47.830451 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:47.837539 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:47.839171 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7def5f20-1c28-4872-894c-bd70d9562494 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1741 microversion: 2.20 time: 0.244960 Sep 18 01:01:47.851561 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 378/754] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:47 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1741 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:48.460341 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f53d2c2b-887e-4a7c-ba73-b97031800dba tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e58a7719-f0fc-4099-92a0-c5c9c3fc0af8"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:48.463213 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f53d2c2b-887e-4a7c-ba73-b97031800dba tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:48.473749 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-11b875aa-7928-4adf-8d34-eef14d886871 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:48.474515 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-11b875aa-7928-4adf-8d34-eef14d886871 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:48.485492 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11b875aa-7928-4adf-8d34-eef14d886871 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:48.488023 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f53d2c2b-887e-4a7c-ba73-b97031800dba tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:48.488756 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11b875aa-7928-4adf-8d34-eef14d886871 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:48.489259 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11b875aa-7928-4adf-8d34-eef14d886871 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:48.489691 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f53d2c2b-887e-4a7c-ba73-b97031800dba tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:48.490507 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11b875aa-7928-4adf-8d34-eef14d886871 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:48.491112 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f53d2c2b-887e-4a7c-ba73-b97031800dba tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:48.492530 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f53d2c2b-887e-4a7c-ba73-b97031800dba tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:48.492636 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f53d2c2b-887e-4a7c-ba73-b97031800dba tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:48.493168 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11b875aa-7928-4adf-8d34-eef14d886871 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:48.493840 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-11b875aa-7928-4adf-8d34-eef14d886871 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:48.495027 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f53d2c2b-887e-4a7c-ba73-b97031800dba tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:48.712459 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-11b875aa-7928-4adf-8d34-eef14d886871 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:48.726123 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-11b875aa-7928-4adf-8d34-eef14d886871 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.257012 Sep 18 01:01:48.727785 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 379/755] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:48 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:48.867799 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:48.868685 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:48.877949 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f53d2c2b-887e-4a7c-ba73-b97031800dba tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "POST /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421075 Sep 18 01:01:48.878585 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 377/756] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 01:01:48 2022] POST /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:01:48.884850 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:48.885673 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:48.886475 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:48.887593 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:48.888429 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:48.889849 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:49.122249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:49.132273 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:49.134018 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:49.135411 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-6e1820e0-7639-47a1-90a2-abbcb6e04bb3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1741 microversion: 2.20 time: 0.272324 Sep 18 01:01:49.136209 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 380/757] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:48 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:01:49.752023 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-dbc4c1d9-c677-4b81-a7ba-2f6a55186568 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:49.752641 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-dbc4c1d9-c677-4b81-a7ba-2f6a55186568 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:49.760154 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbc4c1d9-c677-4b81-a7ba-2f6a55186568 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:49.760525 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbc4c1d9-c677-4b81-a7ba-2f6a55186568 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:49.761059 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbc4c1d9-c677-4b81-a7ba-2f6a55186568 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:49.761821 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbc4c1d9-c677-4b81-a7ba-2f6a55186568 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:49.762290 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbc4c1d9-c677-4b81-a7ba-2f6a55186568 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:49.762724 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-dbc4c1d9-c677-4b81-a7ba-2f6a55186568 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:49.903397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-dbc4c1d9-c677-4b81-a7ba-2f6a55186568 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:49.912179 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-dbc4c1d9-c677-4b81-a7ba-2f6a55186568 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.165182 Sep 18 01:01:49.912849 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 378/758] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:49 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:50.161516 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:50.162213 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:50.168611 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:50.169162 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:50.169688 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:50.170900 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:50.171429 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:50.171929 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:50.303628 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:50.312149 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:50.313742 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:50.315039 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-1036576d-67bb-4117-89a4-250f3b20c2bf tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1741 microversion: 2.20 time: 0.157350 Sep 18 01:01:50.315680 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 381/759] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:50 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:50.938421 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5f96533a-0449-4c58-9257-241701291a13 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:50.939659 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5f96533a-0449-4c58-9257-241701291a13 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:50.942110 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:50.948721 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f96533a-0449-4c58-9257-241701291a13 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:50.949218 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f96533a-0449-4c58-9257-241701291a13 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:50.949656 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f96533a-0449-4c58-9257-241701291a13 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:50.950357 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f96533a-0449-4c58-9257-241701291a13 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:50.950933 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f96533a-0449-4c58-9257-241701291a13 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:50.951504 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f96533a-0449-4c58-9257-241701291a13 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:51.170825 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5f96533a-0449-4c58-9257-241701291a13 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:51.182038 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5f96533a-0449-4c58-9257-241701291a13 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.248843 Sep 18 01:01:51.182761 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 379/760] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:50 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:51.234982 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d998cc27-348a-4212-a1b4-f7a89eefa447 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:51.237502 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d998cc27-348a-4212-a1b4-f7a89eefa447 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:51.245333 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d998cc27-348a-4212-a1b4-f7a89eefa447 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:51.247557 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d998cc27-348a-4212-a1b4-f7a89eefa447 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:51.248712 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d998cc27-348a-4212-a1b4-f7a89eefa447 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:51.250940 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d998cc27-348a-4212-a1b4-f7a89eefa447 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:51.252070 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d998cc27-348a-4212-a1b4-f7a89eefa447 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:51.252645 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d998cc27-348a-4212-a1b4-f7a89eefa447 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:51.293702 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d998cc27-348a-4212-a1b4-f7a89eefa447 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063442 Sep 18 01:01:51.295531 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 382/761] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:01:51 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:51.340708 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:51.341317 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:51.348718 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:51.349281 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:51.349887 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:51.350696 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:51.351250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:51.351784 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:51.435712 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-64bf99a0-6f4a-4f31-b8af-3e6d6b0a81d9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:51.436308 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-64bf99a0-6f4a-4f31-b8af-3e6d6b0a81d9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:51.449676 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64bf99a0-6f4a-4f31-b8af-3e6d6b0a81d9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:51.450313 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64bf99a0-6f4a-4f31-b8af-3e6d6b0a81d9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:51.454771 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64bf99a0-6f4a-4f31-b8af-3e6d6b0a81d9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:51.454771 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64bf99a0-6f4a-4f31-b8af-3e6d6b0a81d9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:51.454771 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64bf99a0-6f4a-4f31-b8af-3e6d6b0a81d9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:51.454771 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-64bf99a0-6f4a-4f31-b8af-3e6d6b0a81d9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:51.488358 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-64bf99a0-6f4a-4f31-b8af-3e6d6b0a81d9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments/bb0903cb-5dd0-497a-a378-be4ae66e26e0" status: 200 len: 194 microversion: 2.1 time: 0.056547 Sep 18 01:01:51.489280 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 383/762] 10.222.0.33 () {58 vars in 1413 bytes} [Sun Sep 18 01:01:51 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments/bb0903cb-5dd0-497a-a378-be4ae66e26e0 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:01:51.499776 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3510b6bf-a33f-4890-b6d4-bbc9e02e256c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:51.500318 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3510b6bf-a33f-4890-b6d4-bbc9e02e256c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:51.506347 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3510b6bf-a33f-4890-b6d4-bbc9e02e256c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:51.507104 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3510b6bf-a33f-4890-b6d4-bbc9e02e256c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:51.507703 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3510b6bf-a33f-4890-b6d4-bbc9e02e256c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:51.508556 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3510b6bf-a33f-4890-b6d4-bbc9e02e256c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:51.509171 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3510b6bf-a33f-4890-b6d4-bbc9e02e256c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:51.509921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3510b6bf-a33f-4890-b6d4-bbc9e02e256c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:51.515883 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:51.525867 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:51.527346 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:51.528828 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-be590306-682f-4aed-a99a-07f68e503df3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1723 microversion: 2.20 time: 0.192048 Sep 18 01:01:51.530220 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 380/763] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:51 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:51.605311 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-3510b6bf-a33f-4890-b6d4-bbc9e02e256c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lazy-loading 'services' on Instance uuid 9b63a4a6-ced3-44e7-ba27-44875b4943f4 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:51.682046 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3510b6bf-a33f-4890-b6d4-bbc9e02e256c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments/bb0903cb-5dd0-497a-a378-be4ae66e26e0" status: 202 len: 0 microversion: 2.1 time: 0.186130 Sep 18 01:01:51.682815 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 384/764] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 01:01:51 2022] DELETE /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments/bb0903cb-5dd0-497a-a378-be4ae66e26e0 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:52.206151 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-772d4b17-3387-4f81-be95-89e7cd579ea6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:52.206861 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-772d4b17-3387-4f81-be95-89e7cd579ea6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:52.212697 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-772d4b17-3387-4f81-be95-89e7cd579ea6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:52.213180 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-772d4b17-3387-4f81-be95-89e7cd579ea6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:52.213616 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-772d4b17-3387-4f81-be95-89e7cd579ea6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:52.214311 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-772d4b17-3387-4f81-be95-89e7cd579ea6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:52.214769 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-772d4b17-3387-4f81-be95-89e7cd579ea6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:52.215215 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-772d4b17-3387-4f81-be95-89e7cd579ea6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:52.353554 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-772d4b17-3387-4f81-be95-89e7cd579ea6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:52.362657 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-772d4b17-3387-4f81-be95-89e7cd579ea6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.160458 Sep 18 01:01:52.363256 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 381/765] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:52 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:52.557792 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:52.558589 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:52.565429 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:52.565912 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:52.566344 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:52.567063 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:52.567515 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:52.568024 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:52.701696 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:52.710938 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:52.712371 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:52.713532 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9a1bcbd9-fb8a-4451-abe4-7cea7f63ed5f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1723 microversion: 2.20 time: 0.160515 Sep 18 01:01:52.714089 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 385/766] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:52 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:53.385795 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-628e8cc3-5fe6-4687-af17-23b747d275b6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:53.386648 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-628e8cc3-5fe6-4687-af17-23b747d275b6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:53.392933 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628e8cc3-5fe6-4687-af17-23b747d275b6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:53.393423 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628e8cc3-5fe6-4687-af17-23b747d275b6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:53.393862 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628e8cc3-5fe6-4687-af17-23b747d275b6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:53.395217 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628e8cc3-5fe6-4687-af17-23b747d275b6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:53.395685 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628e8cc3-5fe6-4687-af17-23b747d275b6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:53.396122 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-628e8cc3-5fe6-4687-af17-23b747d275b6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:53.541821 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-628e8cc3-5fe6-4687-af17-23b747d275b6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:53.552011 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-628e8cc3-5fe6-4687-af17-23b747d275b6 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.170063 Sep 18 01:01:53.552600 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 382/767] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:53 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:53.743504 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:53.744741 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:53.753210 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:53.753707 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:53.754303 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:53.755047 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:53.755511 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:53.755925 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:53.946557 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:53.958282 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:53.960284 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:53.961823 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-55f9349f-5790-4b7b-96cb-c8a592a0dc60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1723 microversion: 2.20 time: 0.225371 Sep 18 01:01:53.962474 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 386/768] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:53 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:54.538047 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-5789b94b-0169-4af3-84cf-bbb2505fc649 req-931d45cd-e0d5-4c2c-a6ed-3d799c2a82c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f4bab30-d9b2-4713-ab65-46a4754f8153", "name": "network-vif-unplugged", "status": "completed", "tag": "41948106-b5ee-425d-bfed-b11f6d5cdb7e"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:54.549715 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-5789b94b-0169-4af3-84cf-bbb2505fc649 req-931d45cd-e0d5-4c2c-a6ed-3d799c2a82c9 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:54.550202 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-5789b94b-0169-4af3-84cf-bbb2505fc649 req-931d45cd-e0d5-4c2c-a6ed-3d799c2a82c9 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:54.551143 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-5789b94b-0169-4af3-84cf-bbb2505fc649 req-931d45cd-e0d5-4c2c-a6ed-3d799c2a82c9 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:54.564004 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-5789b94b-0169-4af3-84cf-bbb2505fc649 req-931d45cd-e0d5-4c2c-a6ed-3d799c2a82c9 service nova] Creating event network-vif-unplugged:41948106-b5ee-425d-bfed-b11f6d5cdb7e for instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 on hv-cinder-maste Sep 18 01:01:54.569204 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-5789b94b-0169-4af3-84cf-bbb2505fc649 req-931d45cd-e0d5-4c2c-a6ed-3d799c2a82c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.235130 Sep 18 01:01:54.569798 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 383/769] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:54.575997 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a1f6a8d5-9588-4886-9e6b-c27a872d068f tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:54.576780 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-a1f6a8d5-9588-4886-9e6b-c27a872d068f tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:54.583365 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a1f6a8d5-9588-4886-9e6b-c27a872d068f tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:54.583845 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a1f6a8d5-9588-4886-9e6b-c27a872d068f tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:54.584274 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a1f6a8d5-9588-4886-9e6b-c27a872d068f tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:54.585057 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a1f6a8d5-9588-4886-9e6b-c27a872d068f tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:54.585526 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a1f6a8d5-9588-4886-9e6b-c27a872d068f tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:54.586109 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a1f6a8d5-9588-4886-9e6b-c27a872d068f tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:54.781051 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a1f6a8d5-9588-4886-9e6b-c27a872d068f tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:54.793559 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a1f6a8d5-9588-4886-9e6b-c27a872d068f tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.221920 Sep 18 01:01:54.794135 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 387/770] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:54 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:54.948018 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a33276a5-6438-4117-8776-fd83eb39c4d2 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:54.948543 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a33276a5-6438-4117-8776-fd83eb39c4d2 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:54.956819 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a33276a5-6438-4117-8776-fd83eb39c4d2 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:54.957317 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a33276a5-6438-4117-8776-fd83eb39c4d2 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:54.957757 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a33276a5-6438-4117-8776-fd83eb39c4d2 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:54.958458 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a33276a5-6438-4117-8776-fd83eb39c4d2 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:54.958943 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a33276a5-6438-4117-8776-fd83eb39c4d2 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:54.959376 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a33276a5-6438-4117-8776-fd83eb39c4d2 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:54.989187 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:54.989932 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:54.993918 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a33276a5-6438-4117-8776-fd83eb39c4d2 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments/e58a7719-f0fc-4099-92a0-c5c9c3fc0af8" status: 200 len: 194 microversion: 2.1 time: 0.050426 Sep 18 01:01:54.994513 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 384/771] 10.222.0.33 () {58 vars in 1413 bytes} [Sun Sep 18 01:01:54 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments/e58a7719-f0fc-4099-92a0-c5c9c3fc0af8 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:01:55.001249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.001249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.001249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:55.001249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.001590 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.001722 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:55.006729 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f49a8067-b540-4136-97fd-5cbe379643f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:55.007254 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f49a8067-b540-4136-97fd-5cbe379643f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:55.013729 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49a8067-b540-4136-97fd-5cbe379643f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.014226 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49a8067-b540-4136-97fd-5cbe379643f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.014659 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49a8067-b540-4136-97fd-5cbe379643f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:55.015382 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49a8067-b540-4136-97fd-5cbe379643f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.015839 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49a8067-b540-4136-97fd-5cbe379643f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.016261 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f49a8067-b540-4136-97fd-5cbe379643f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:55.129977 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-f49a8067-b540-4136-97fd-5cbe379643f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lazy-loading 'services' on Instance uuid 9b63a4a6-ced3-44e7-ba27-44875b4943f4 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:01:55.173393 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:55.183856 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:55.186402 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:55.188043 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7715c31e-0f35-4888-925f-7d02125040bb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1726 microversion: 2.20 time: 0.203760 Sep 18 01:01:55.192859 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 388/772] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:54 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1726 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:01:55.226432 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8f1c1d54-2e5c-4819-9640-eac1ace9ae60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4023465-899a-4996-9fec-0b7f48ce075b"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:55.230741 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8f1c1d54-2e5c-4819-9640-eac1ace9ae60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:55.242502 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f49a8067-b540-4136-97fd-5cbe379643f6 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments/e58a7719-f0fc-4099-92a0-c5c9c3fc0af8" status: 202 len: 0 microversion: 2.1 time: 0.239239 Sep 18 01:01:55.243428 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 385/773] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 01:01:55 2022] DELETE /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments/e58a7719-f0fc-4099-92a0-c5c9c3fc0af8 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:55.250009 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1c1d54-2e5c-4819-9640-eac1ace9ae60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.250518 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1c1d54-2e5c-4819-9640-eac1ace9ae60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.250993 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1c1d54-2e5c-4819-9640-eac1ace9ae60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:55.251887 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1c1d54-2e5c-4819-9640-eac1ace9ae60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.252536 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1c1d54-2e5c-4819-9640-eac1ace9ae60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.253128 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1c1d54-2e5c-4819-9640-eac1ace9ae60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:55.553371 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8f1c1d54-2e5c-4819-9640-eac1ace9ae60 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "POST /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.337061 Sep 18 01:01:55.554357 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 389/774] 10.222.0.33 () {62 vars in 1364 bytes} [Sun Sep 18 01:01:55 2022] POST /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/os-volume_attachments => generated 188 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 18 01:01:55.689322 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b3dcda6d-87a1-4c76-81fc-71d341bbf235 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:55.689913 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b3dcda6d-87a1-4c76-81fc-71d341bbf235 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:55.695981 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b3dcda6d-87a1-4c76-81fc-71d341bbf235 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.696474 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b3dcda6d-87a1-4c76-81fc-71d341bbf235 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.696917 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b3dcda6d-87a1-4c76-81fc-71d341bbf235 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:55.697617 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b3dcda6d-87a1-4c76-81fc-71d341bbf235 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.698082 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b3dcda6d-87a1-4c76-81fc-71d341bbf235 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.698510 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b3dcda6d-87a1-4c76-81fc-71d341bbf235 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:55.714356 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:55.817628 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-314cb800-b245-4dd2-8bcb-852baea53b48 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:55.818262 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-314cb800-b245-4dd2-8bcb-852baea53b48 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:55.828582 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-314cb800-b245-4dd2-8bcb-852baea53b48 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.829084 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-314cb800-b245-4dd2-8bcb-852baea53b48 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.829704 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-314cb800-b245-4dd2-8bcb-852baea53b48 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:55.830451 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-314cb800-b245-4dd2-8bcb-852baea53b48 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:55.831615 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-314cb800-b245-4dd2-8bcb-852baea53b48 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:55.832041 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-314cb800-b245-4dd2-8bcb-852baea53b48 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:55.985156 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b3dcda6d-87a1-4c76-81fc-71d341bbf235 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/os-volume_attachments/c4023465-899a-4996-9fec-0b7f48ce075b" status: 202 len: 0 microversion: 2.20 time: 0.300837 Sep 18 01:01:55.986542 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 386/775] 10.222.0.33 () {60 vars in 1457 bytes} [Sun Sep 18 01:01:55 2022] DELETE /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/os-volume_attachments/c4023465-899a-4996-9fec-0b7f48ce075b => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:55.989362 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-314cb800-b245-4dd2-8bcb-852baea53b48 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:55.998900 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-314cb800-b245-4dd2-8bcb-852baea53b48 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.184900 Sep 18 01:01:55.999484 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 390/776] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:55 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:56.058315 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-fff77bcf-173a-4444-9dbc-6ddf875c0acc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:56.058954 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-fff77bcf-173a-4444-9dbc-6ddf875c0acc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:56.065997 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fff77bcf-173a-4444-9dbc-6ddf875c0acc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:56.066491 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fff77bcf-173a-4444-9dbc-6ddf875c0acc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:56.066977 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fff77bcf-173a-4444-9dbc-6ddf875c0acc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:56.067683 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fff77bcf-173a-4444-9dbc-6ddf875c0acc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:56.068238 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fff77bcf-173a-4444-9dbc-6ddf875c0acc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:56.068566 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-fff77bcf-173a-4444-9dbc-6ddf875c0acc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:56.100142 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-fff77bcf-173a-4444-9dbc-6ddf875c0acc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120687) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 18 01:01:56.171756 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-fff77bcf-173a-4444-9dbc-6ddf875c0acc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "POST /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/action" status: 202 len: 0 microversion: 2.20 time: 0.117427 Sep 18 01:01:56.173502 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 387/777] 10.222.0.33 () {62 vars in 1319 bytes} [Sun Sep 18 01:01:56 2022] POST /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:56.181827 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:56.182745 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:56.189395 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:56.189895 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:56.190334 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:56.191352 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:56.191817 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:56.192245 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:56.365252 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:56.380198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:56.381906 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:56.384417 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0112031e-bd0b-4692-9e6c-f75f45e8545b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1674 microversion: 2.20 time: 0.206092 Sep 18 01:01:56.386452 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 391/778] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:56 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1674 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:57.024948 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-40a3c58c-7cbd-4318-9c6d-b244a6edbaa9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:57.026209 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-40a3c58c-7cbd-4318-9c6d-b244a6edbaa9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:57.033812 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40a3c58c-7cbd-4318-9c6d-b244a6edbaa9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:57.034617 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40a3c58c-7cbd-4318-9c6d-b244a6edbaa9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:57.035174 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40a3c58c-7cbd-4318-9c6d-b244a6edbaa9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:57.036293 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40a3c58c-7cbd-4318-9c6d-b244a6edbaa9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:57.036976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40a3c58c-7cbd-4318-9c6d-b244a6edbaa9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:57.037497 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-40a3c58c-7cbd-4318-9c6d-b244a6edbaa9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:57.266738 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-40a3c58c-7cbd-4318-9c6d-b244a6edbaa9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:57.275444 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-40a3c58c-7cbd-4318-9c6d-b244a6edbaa9 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.255077 Sep 18 01:01:57.275942 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 388/779] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:57 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:57.416663 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:57.417716 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:57.429440 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:57.429945 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:57.430391 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:57.431161 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:57.431754 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:57.432190 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:57.455416 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:57.628572 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:57.641705 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:57.644098 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:57.647478 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-90311dd6-3df4-4f7e-a2be-e14fdb650e8f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1674 microversion: 2.20 time: 0.239289 Sep 18 01:01:57.648220 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 392/780] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:57 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1674 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:57.788387 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-4dafde94-e0cc-4db5-b7bd-5e03f58365b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:57.790598 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-4dafde94-e0cc-4db5-b7bd-5e03f58365b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:57.797592 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dafde94-e0cc-4db5-b7bd-5e03f58365b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:57.798260 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dafde94-e0cc-4db5-b7bd-5e03f58365b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:57.798899 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dafde94-e0cc-4db5-b7bd-5e03f58365b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:57.799634 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dafde94-e0cc-4db5-b7bd-5e03f58365b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:57.800220 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dafde94-e0cc-4db5-b7bd-5e03f58365b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:57.800655 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-4dafde94-e0cc-4db5-b7bd-5e03f58365b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:57.830928 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-4dafde94-e0cc-4db5-b7bd-5e03f58365b4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048639 Sep 18 01:01:57.831491 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 389/781] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:01:57 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:57.952796 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a5bafd48-04e7-4285-8a1c-bcb07f9e3b0a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:57.955144 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-a5bafd48-04e7-4285-8a1c-bcb07f9e3b0a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:57.971019 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5bafd48-04e7-4285-8a1c-bcb07f9e3b0a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:57.971611 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5bafd48-04e7-4285-8a1c-bcb07f9e3b0a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:57.972496 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5bafd48-04e7-4285-8a1c-bcb07f9e3b0a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:57.972806 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5bafd48-04e7-4285-8a1c-bcb07f9e3b0a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:57.973408 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5bafd48-04e7-4285-8a1c-bcb07f9e3b0a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:57.973850 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a5bafd48-04e7-4285-8a1c-bcb07f9e3b0a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.005391 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a5bafd48-04e7-4285-8a1c-bcb07f9e3b0a tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057322 Sep 18 01:01:58.005950 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 393/782] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:01:57 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:01:58.069398 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8ae4bc49-db97-4b33-a569-1e82f7a5b097 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:58.069901 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8ae4bc49-db97-4b33-a569-1e82f7a5b097 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:58.076788 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8ae4bc49-db97-4b33-a569-1e82f7a5b097 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.077281 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8ae4bc49-db97-4b33-a569-1e82f7a5b097 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.077714 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8ae4bc49-db97-4b33-a569-1e82f7a5b097 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.078405 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8ae4bc49-db97-4b33-a569-1e82f7a5b097 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.078894 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8ae4bc49-db97-4b33-a569-1e82f7a5b097 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.079321 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8ae4bc49-db97-4b33-a569-1e82f7a5b097 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.103779 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8ae4bc49-db97-4b33-a569-1e82f7a5b097 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Going to try to terminate instance {{(pid=120687) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:01:58.185564 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8ae4bc49-db97-4b33-a569-1e82f7a5b097 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 204 len: 0 microversion: 2.1 time: 0.118976 Sep 18 01:01:58.186242 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 390/783] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:01:58 2022] DELETE /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:01:58.196910 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-349e1b8f-8b50-463a-a4b9-fcf09bfaff66 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:58.197845 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-349e1b8f-8b50-463a-a4b9-fcf09bfaff66 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:58.204370 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-349e1b8f-8b50-463a-a4b9-fcf09bfaff66 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.204852 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-349e1b8f-8b50-463a-a4b9-fcf09bfaff66 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.205285 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-349e1b8f-8b50-463a-a4b9-fcf09bfaff66 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.205973 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-349e1b8f-8b50-463a-a4b9-fcf09bfaff66 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.206569 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-349e1b8f-8b50-463a-a4b9-fcf09bfaff66 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.207234 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-349e1b8f-8b50-463a-a4b9-fcf09bfaff66 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.300107 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-acb5a6cd-fb55-4167-a7d0-735f6e54cffb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:58.300720 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-acb5a6cd-fb55-4167-a7d0-735f6e54cffb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:58.307283 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acb5a6cd-fb55-4167-a7d0-735f6e54cffb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.307775 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acb5a6cd-fb55-4167-a7d0-735f6e54cffb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.308207 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acb5a6cd-fb55-4167-a7d0-735f6e54cffb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.310207 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acb5a6cd-fb55-4167-a7d0-735f6e54cffb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.310751 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acb5a6cd-fb55-4167-a7d0-735f6e54cffb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.311226 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acb5a6cd-fb55-4167-a7d0-735f6e54cffb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.399931 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-349e1b8f-8b50-463a-a4b9-fcf09bfaff66 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:58.409092 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-349e1b8f-8b50-463a-a4b9-fcf09bfaff66 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1673 microversion: 2.1 time: 0.218020 Sep 18 01:01:58.409791 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 394/784] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:58 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1673 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:01:58.471544 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-acb5a6cd-fb55-4167-a7d0-735f6e54cffb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:58.479308 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-acb5a6cd-fb55-4167-a7d0-735f6e54cffb tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1568 microversion: 2.1 time: 0.183778 Sep 18 01:01:58.479865 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 391/785] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:58 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:58.503744 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8a8bee50-0e90-4b73-b1c0-1f9aadff0672 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:01:58.504361 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8a8bee50-0e90-4b73-b1c0-1f9aadff0672 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:58.510987 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8a8bee50-0e90-4b73-b1c0-1f9aadff0672 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.511472 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8a8bee50-0e90-4b73-b1c0-1f9aadff0672 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.511906 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8a8bee50-0e90-4b73-b1c0-1f9aadff0672 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.512594 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8a8bee50-0e90-4b73-b1c0-1f9aadff0672 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.513246 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8a8bee50-0e90-4b73-b1c0-1f9aadff0672 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.513828 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8a8bee50-0e90-4b73-b1c0-1f9aadff0672 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.600731 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8a8bee50-0e90-4b73-b1c0-1f9aadff0672 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120686) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 18 01:01:58.678958 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:58.679564 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:58.686874 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.687368 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.687824 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.688512 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.688970 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.689386 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.695403 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8a8bee50-0e90-4b73-b1c0-1f9aadff0672 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "POST /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95/action" status: 202 len: 0 microversion: 2.1 time: 0.195567 Sep 18 01:01:58.696214 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 395/786] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 01:01:58 2022] POST /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:01:58.704172 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-916c8cd3-354e-4e67-a88e-97542097b3aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:58.704544 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-916c8cd3-354e-4e67-a88e-97542097b3aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:58.712066 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-916c8cd3-354e-4e67-a88e-97542097b3aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.712646 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-916c8cd3-354e-4e67-a88e-97542097b3aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.713047 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-916c8cd3-354e-4e67-a88e-97542097b3aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.713755 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-916c8cd3-354e-4e67-a88e-97542097b3aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:58.714218 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-916c8cd3-354e-4e67-a88e-97542097b3aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:58.714643 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-916c8cd3-354e-4e67-a88e-97542097b3aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:58.971040 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:58.975989 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:58.977417 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:58.978598 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-45f93b5b-75c5-4762-98de-17cbebc5ca2b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1676 microversion: 2.20 time: 0.304014 Sep 18 01:01:58.991057 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 392/787] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:01:58 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1676 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:01:58.991581 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-916c8cd3-354e-4e67-a88e-97542097b3aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:58.999067 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-916c8cd3-354e-4e67-a88e-97542097b3aa tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1516 microversion: 2.1 time: 0.298950 Sep 18 01:01:58.999636 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 396/788] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:58 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1516 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:01:59.434093 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-cb993663-a9f0-4309-980b-b47aa1a08a5c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:01:59.434700 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-cb993663-a9f0-4309-980b-b47aa1a08a5c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:01:59.440973 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cb993663-a9f0-4309-980b-b47aa1a08a5c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:59.441465 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cb993663-a9f0-4309-980b-b47aa1a08a5c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:59.441903 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cb993663-a9f0-4309-980b-b47aa1a08a5c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:59.442628 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cb993663-a9f0-4309-980b-b47aa1a08a5c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:01:59.443113 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cb993663-a9f0-4309-980b-b47aa1a08a5c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:01:59.443542 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cb993663-a9f0-4309-980b-b47aa1a08a5c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:01:59.579110 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-cb993663-a9f0-4309-980b-b47aa1a08a5c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:01:59.586818 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-cb993663-a9f0-4309-980b-b47aa1a08a5c tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1673 microversion: 2.1 time: 0.157164 Sep 18 01:01:59.587390 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 393/789] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:01:59 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:00.005437 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:00.006078 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:00.012558 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.013048 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.013487 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.014182 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.014642 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.015116 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.021703 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-557bf873-cab9-4fe9-aa62-7c04893dea28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:00.022385 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-557bf873-cab9-4fe9-aa62-7c04893dea28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:00.028917 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-557bf873-cab9-4fe9-aa62-7c04893dea28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.029678 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-557bf873-cab9-4fe9-aa62-7c04893dea28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.030186 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-557bf873-cab9-4fe9-aa62-7c04893dea28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.031035 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-557bf873-cab9-4fe9-aa62-7c04893dea28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.031502 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-557bf873-cab9-4fe9-aa62-7c04893dea28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.031965 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-557bf873-cab9-4fe9-aa62-7c04893dea28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.196131 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-557bf873-cab9-4fe9-aa62-7c04893dea28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:00.206714 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-557bf873-cab9-4fe9-aa62-7c04893dea28 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1516 microversion: 2.1 time: 0.188674 Sep 18 01:02:00.207481 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 394/790] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:00 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:00.212452 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-05698a9b-787c-45e6-97c6-6f51d0578b17 req-997200f5-bc88-4fcd-975d-7489d3d8cc1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a39d642-1c36-48cb-909b-751208990b95", "name": "network-vif-unplugged", "status": "completed", "tag": "168733ef-a9ab-4b45-b7c7-dd94d6a8994b"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:00.236516 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-05698a9b-787c-45e6-97c6-6f51d0578b17 req-997200f5-bc88-4fcd-975d-7489d3d8cc1f service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.237005 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-05698a9b-787c-45e6-97c6-6f51d0578b17 req-997200f5-bc88-4fcd-975d-7489d3d8cc1f service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.237439 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-05698a9b-787c-45e6-97c6-6f51d0578b17 req-997200f5-bc88-4fcd-975d-7489d3d8cc1f service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.254272 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.compute.server_external_events [req-05698a9b-787c-45e6-97c6-6f51d0578b17 req-997200f5-bc88-4fcd-975d-7489d3d8cc1f service nova] Unable to find a host for instance 5a39d642-1c36-48cb-909b-751208990b95. Dropping event network-vif-unplugged {{(pid=120687) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 18 01:02:00.255794 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-05698a9b-787c-45e6-97c6-6f51d0578b17 req-997200f5-bc88-4fcd-975d-7489d3d8cc1f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046963 Sep 18 01:02:00.256765 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 395/791] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 18 01:02:00.314704 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:00.323075 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:00.324513 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:00.326131 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ef444042-0c94-49be-b2cb-34871e8f3486 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1676 microversion: 2.20 time: 0.324279 Sep 18 01:02:00.326693 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 397/792] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:00 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1676 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:00.609889 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-83715601-2d85-41db-ad2e-b394198dc174 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:00.610562 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-83715601-2d85-41db-ad2e-b394198dc174 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:00.617274 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83715601-2d85-41db-ad2e-b394198dc174 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.617804 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83715601-2d85-41db-ad2e-b394198dc174 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.618248 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83715601-2d85-41db-ad2e-b394198dc174 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.619015 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83715601-2d85-41db-ad2e-b394198dc174 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:00.619482 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83715601-2d85-41db-ad2e-b394198dc174 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:00.619930 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83715601-2d85-41db-ad2e-b394198dc174 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:00.759475 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-83715601-2d85-41db-ad2e-b394198dc174 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:00.767622 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-83715601-2d85-41db-ad2e-b394198dc174 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1673 microversion: 2.1 time: 0.162090 Sep 18 01:02:00.768174 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 396/793] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:00 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:01.230732 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-df54ce28-fb79-4da0-a3a9-5fcea64a78f8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:01.232540 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-df54ce28-fb79-4da0-a3a9-5fcea64a78f8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:01.239637 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-df54ce28-fb79-4da0-a3a9-5fcea64a78f8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:01.240244 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-df54ce28-fb79-4da0-a3a9-5fcea64a78f8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:01.241037 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-df54ce28-fb79-4da0-a3a9-5fcea64a78f8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:01.242003 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-df54ce28-fb79-4da0-a3a9-5fcea64a78f8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:01.242572 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-df54ce28-fb79-4da0-a3a9-5fcea64a78f8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:01.243128 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-df54ce28-fb79-4da0-a3a9-5fcea64a78f8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:01.360236 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:01.361450 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:01.370674 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:01.371779 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:01.372776 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:01.373935 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:01.374960 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:01.375428 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:01.543645 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-df54ce28-fb79-4da0-a3a9-5fcea64a78f8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:01.553799 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-df54ce28-fb79-4da0-a3a9-5fcea64a78f8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1518 microversion: 2.1 time: 0.327202 Sep 18 01:02:01.592074 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 398/794] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:01 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1518 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:01.645016 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:01.670710 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:01.673059 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:01.675334 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-be2f2e95-8e85-4795-8665-cf0d1ac8323f tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.323640 Sep 18 01:02:01.676593 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 397/795] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:01 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:01.792194 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-83cb94a3-dc1b-4b0d-b75f-e88580c1f0c4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:01.799539 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-83cb94a3-dc1b-4b0d-b75f-e88580c1f0c4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:01.807827 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83cb94a3-dc1b-4b0d-b75f-e88580c1f0c4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:01.808589 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83cb94a3-dc1b-4b0d-b75f-e88580c1f0c4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:01.810331 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83cb94a3-dc1b-4b0d-b75f-e88580c1f0c4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:01.811441 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83cb94a3-dc1b-4b0d-b75f-e88580c1f0c4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:01.812870 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83cb94a3-dc1b-4b0d-b75f-e88580c1f0c4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:01.813535 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-83cb94a3-dc1b-4b0d-b75f-e88580c1f0c4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:01.847728 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:01.901285 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-83cb94a3-dc1b-4b0d-b75f-e88580c1f0c4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:01.908173 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-34069886-45ae-4b8c-9156-399b83f85972 req-10b5e9d6-af2c-47d7-a228-bc0427bca159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b63a4a6-ced3-44e7-ba27-44875b4943f4", "name": "network-vif-deleted", "tag": "e361fc39-aed8-424c-893a-c016b77dcdc2"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:01.920060 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-83cb94a3-dc1b-4b0d-b75f-e88580c1f0c4 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1321 microversion: 2.1 time: 0.130746 Sep 18 01:02:01.921703 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 398/796] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:01 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1321 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:01.925695 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-34069886-45ae-4b8c-9156-399b83f85972 req-10b5e9d6-af2c-47d7-a228-bc0427bca159 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:01.926537 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-34069886-45ae-4b8c-9156-399b83f85972 req-10b5e9d6-af2c-47d7-a228-bc0427bca159 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:01.927492 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-34069886-45ae-4b8c-9156-399b83f85972 req-10b5e9d6-af2c-47d7-a228-bc0427bca159 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:01.946074 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-34069886-45ae-4b8c-9156-399b83f85972 req-10b5e9d6-af2c-47d7-a228-bc0427bca159 service nova] Creating event network-vif-deleted:e361fc39-aed8-424c-893a-c016b77dcdc2 for instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 on hv-cinder-maste Sep 18 01:02:01.953797 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-34069886-45ae-4b8c-9156-399b83f85972 req-10b5e9d6-af2c-47d7-a228-bc0427bca159 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200323 Sep 18 01:02:01.955288 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 399/797] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:02.587835 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-cd730165-f0c0-46c1-bab6-cc38f2fd6374 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:02.588442 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-cd730165-f0c0-46c1-bab6-cc38f2fd6374 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:02.598556 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd730165-f0c0-46c1-bab6-cc38f2fd6374 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.599242 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd730165-f0c0-46c1-bab6-cc38f2fd6374 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.599718 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd730165-f0c0-46c1-bab6-cc38f2fd6374 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.600664 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd730165-f0c0-46c1-bab6-cc38f2fd6374 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.601418 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd730165-f0c0-46c1-bab6-cc38f2fd6374 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.601567 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-cd730165-f0c0-46c1-bab6-cc38f2fd6374 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.707081 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:02.708036 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:02.720040 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.721253 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.722379 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.723666 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.724474 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.725211 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.780584 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-cd730165-f0c0-46c1-bab6-cc38f2fd6374 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:02.799879 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-cd730165-f0c0-46c1-bab6-cc38f2fd6374 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.216397 Sep 18 01:02:02.800844 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 399/798] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:02 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:02.888276 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:02.898191 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:02.899669 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:02.901274 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-72b5a51e-c372-4058-a419-898dee789ffb tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.202980 Sep 18 01:02:02.903185 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 400/799] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:02 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:02.944646 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:02.945271 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:02.960643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.962711 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.963194 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:02.963936 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:02.964584 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:02.965025 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:03.053110 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:03.053612 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:03.057945 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:03.058612 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lazy-loading 'fault' on Instance uuid 9b63a4a6-ced3-44e7-ba27-44875b4943f4 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:02:03.123471 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e49a94877574c58aa4ff068b69a3dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60d2801df884e15be8a0464cb725d6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:03.130990 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-550a5a72-367a-41e7-8350-a78d1a160e97 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 200 len: 1326 microversion: 2.1 time: 0.190228 Sep 18 01:02:03.139097 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 400/800] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:02 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 1326 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:03.827016 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9db5611f-1156-4976-9b66-4ba822901ea3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:03.827645 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9db5611f-1156-4976-9b66-4ba822901ea3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:03.834226 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9db5611f-1156-4976-9b66-4ba822901ea3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:03.834729 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9db5611f-1156-4976-9b66-4ba822901ea3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:03.835189 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9db5611f-1156-4976-9b66-4ba822901ea3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:03.835878 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9db5611f-1156-4976-9b66-4ba822901ea3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:03.836590 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9db5611f-1156-4976-9b66-4ba822901ea3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:03.837416 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9db5611f-1156-4976-9b66-4ba822901ea3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:03.942293 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:03.943911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:03.949316 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:03.949931 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:03.950441 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:03.951352 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:03.951885 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:03.952320 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:03.998588 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9db5611f-1156-4976-9b66-4ba822901ea3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:04.008406 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9db5611f-1156-4976-9b66-4ba822901ea3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.186713 Sep 18 01:02:04.008999 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 401/801] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:03 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:04.123040 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:04.131553 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:04.132988 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:04.134164 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b703d208-3c07-4598-9f0a-285ff1ea8989 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.197219 Sep 18 01:02:04.135062 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 401/802] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:03 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:02:04.160159 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:04.161093 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:04.167210 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:04.167699 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:04.168133 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:04.169449 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:04.169898 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:04.170348 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:04.185272 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] HTTP exception thrown: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Request method failure captured: Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 HTTP/1.1 Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmynEdNL7pAf1LovTldThupAVrePdjpWMxOnZKz4r-6pbCS15yBIvLlIATJ4grvojw4g5Raldgq6JL_4BlZSX21FYvBVnO9YPAVAttzmSKR5FH7h-tEAEcnxtuF-yTXEZYmZzhDe4A2PDTjtn66SZzhOc4zmSwuEzFRV0iiUIus1qgU Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:02:04.187457 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a60d2801df884e15be8a0464cb725d6d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}] Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 5e49a94877574c58aa4ff068b69a3dd6 Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:04.190497 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '9b63a4a6-ced3-44e7-ba27-44875b4943f4'} Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:04.191447 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:04.195086 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:04.198355 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Returning 404 to user: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:04.198355 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b1c8f337-61a1-42b1-b3a3-29b31fc1e184 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 404 len: 111 microversion: 2.1 time: 0.035763 Sep 18 01:02:04.198355 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 402/803] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:04 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:04.199097 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-73fb3022-1c5e-431b-898a-e931afc4b7b0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '.version_select at 0x7f5672aaef70>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:04.222455 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-73fb3022-1c5e-431b-898a-e931afc4b7b0 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131484346" status: 202 len: 0 microversion: 2.1 time: 0.027185 Sep 18 01:02:04.223104 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 402/804] 10.222.0.33 () {58 vars in 1221 bytes} [Sun Sep 18 01:02:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131484346 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 18 01:02:05.039767 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-aaf354d5-6257-4467-b104-88d843823f05 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:05.040501 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-aaf354d5-6257-4467-b104-88d843823f05 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:05.047601 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aaf354d5-6257-4467-b104-88d843823f05 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:05.048861 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aaf354d5-6257-4467-b104-88d843823f05 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:05.049409 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aaf354d5-6257-4467-b104-88d843823f05 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:05.050228 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aaf354d5-6257-4467-b104-88d843823f05 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:05.050765 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aaf354d5-6257-4467-b104-88d843823f05 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:05.051290 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-aaf354d5-6257-4467-b104-88d843823f05 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:05.166500 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:05.167910 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:05.177084 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:05.177936 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:05.178769 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:05.179745 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:05.180633 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:05.181226 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:05.238222 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-aaf354d5-6257-4467-b104-88d843823f05 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:05.252387 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-aaf354d5-6257-4467-b104-88d843823f05 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.219828 Sep 18 01:02:05.253553 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 403/805] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:05 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:05.354043 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:05.364901 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:05.366847 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:05.368116 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9f45be7b-7ac6-44a9-9aee-5a88fde7517b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.208083 Sep 18 01:02:05.369020 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 403/806] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:05 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:02:06.279013 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-fbb6163c-961a-45c8-8f6b-a384a3c4d9a0 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:06.279603 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-fbb6163c-961a-45c8-8f6b-a384a3c4d9a0 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:06.287424 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fbb6163c-961a-45c8-8f6b-a384a3c4d9a0 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:06.288096 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fbb6163c-961a-45c8-8f6b-a384a3c4d9a0 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:06.288765 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fbb6163c-961a-45c8-8f6b-a384a3c4d9a0 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:06.289838 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fbb6163c-961a-45c8-8f6b-a384a3c4d9a0 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:06.290929 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fbb6163c-961a-45c8-8f6b-a384a3c4d9a0 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:06.291689 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-fbb6163c-961a-45c8-8f6b-a384a3c4d9a0 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:06.396368 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:06.396774 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:06.406043 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:06.406625 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:06.407169 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:06.407939 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:06.408583 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:06.409068 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:06.467365 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-fbb6163c-961a-45c8-8f6b-a384a3c4d9a0 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:06.476623 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-fbb6163c-961a-45c8-8f6b-a384a3c4d9a0 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.202179 Sep 18 01:02:06.487500 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 404/807] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:06 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:06.594338 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:06.604280 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:06.606029 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:06.607904 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5a0d44f5-3439-4b13-9601-cac9420568c3 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.215631 Sep 18 01:02:06.608709 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 404/808] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:06 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:07.398253 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:07.398755 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:07.406343 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.406847 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.407282 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.407975 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.408429 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.408853 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.423428 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] HTTP exception thrown: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Request method failure captured: Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: DELETE /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 HTTP/1.1 Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmynEdNL7pAf1LovTldThupAVrePdjpWMxOnZKz4r-6pbCS15yBIvLlIATJ4grvojw4g5Raldgq6JL_4BlZSX21FYvBVnO9YPAVAttzmSKR5FH7h-tEAEcnxtuF-yTXEZYmZzhDe4A2PDTjtn66SZzhOc4zmSwuEzFRV0iiUIus1qgU Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:02:07.424960 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a60d2801df884e15be8a0464cb725d6d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}] Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 5e49a94877574c58aa4ff068b69a3dd6 Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:07.426419 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '9b63a4a6-ced3-44e7-ba27-44875b4943f4'} Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:07.427538 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:07.429014 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:07.430921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Returning 404 to user: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:07.430921 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-feee0e15-19bd-464b-841a-5d4a4ace23b9 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 404 len: 111 microversion: 2.1 time: 0.031903 Sep 18 01:02:07.430921 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 405/809] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:02:07 2022] DELETE /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:07.435029 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:07.435697 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: 9b63a4a6-ced3-44e7-ba27-44875b4943f4] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:07.442657 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.443227 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.443698 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.444450 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.444912 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.445343 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.460740 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] HTTP exception thrown: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Request method failure captured: Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 HTTP/1.1 Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmynEdNL7pAf1LovTldThupAVrePdjpWMxOnZKz4r-6pbCS15yBIvLlIATJ4grvojw4g5Raldgq6JL_4BlZSX21FYvBVnO9YPAVAttzmSKR5FH7h-tEAEcnxtuF-yTXEZYmZzhDe4A2PDTjtn66SZzhOc4zmSwuEzFRV0iiUIus1qgU Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:02:07.462434 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a60d2801df884e15be8a0464cb725d6d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}] Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 5e49a94877574c58aa4ff068b69a3dd6 Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:07.463866 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '9b63a4a6-ced3-44e7-ba27-44875b4943f4'} Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:07.464664 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. Sep 18 01:02:07.466522 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:07.467664 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Returning 404 to user: Instance 9b63a4a6-ced3-44e7-ba27-44875b4943f4 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:07.467664 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-85298d06-c4c0-4993-8fb4-df17d4a500b8 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4" status: 404 len: 111 microversion: 2.1 time: 0.032975 Sep 18 01:02:07.467664 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 405/810] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:07 2022] GET /compute/v2.1/servers/9b63a4a6-ced3-44e7-ba27-44875b4943f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:02:07.503332 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7b94b4f9-df85-41db-ba5b-005e4dc4d60a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:07.504109 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7b94b4f9-df85-41db-ba5b-005e4dc4d60a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:07.513962 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7b94b4f9-df85-41db-ba5b-005e4dc4d60a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.519723 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7b94b4f9-df85-41db-ba5b-005e4dc4d60a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.520751 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7b94b4f9-df85-41db-ba5b-005e4dc4d60a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.521924 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7b94b4f9-df85-41db-ba5b-005e4dc4d60a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.523090 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7b94b4f9-df85-41db-ba5b-005e4dc4d60a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.523845 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7b94b4f9-df85-41db-ba5b-005e4dc4d60a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.641742 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:07.642361 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:07.648920 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.649459 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.649909 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.650645 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:07.651203 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:07.651635 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:07.692609 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7b94b4f9-df85-41db-ba5b-005e4dc4d60a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:07.704837 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7b94b4f9-df85-41db-ba5b-005e4dc4d60a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.205484 Sep 18 01:02:07.706133 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 406/811] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:07 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:08.090998 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:08.099844 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:08.101365 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:08.102701 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-6cfaa09b-8092-436c-bd81-3a1c7da32cbe tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.465620 Sep 18 01:02:08.103708 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 406/812] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:07 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:02:08.299727 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-145a7dee-4ad9-42c7-8dd0-fcc87a767761 req-9586196d-92f0-4fb3-8717-f13dcd7963a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a39d642-1c36-48cb-909b-751208990b95", "name": "network-vif-plugged", "status": "completed", "tag": "168733ef-a9ab-4b45-b7c7-dd94d6a8994b"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:08.320417 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-145a7dee-4ad9-42c7-8dd0-fcc87a767761 req-9586196d-92f0-4fb3-8717-f13dcd7963a7 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:08.321312 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-145a7dee-4ad9-42c7-8dd0-fcc87a767761 req-9586196d-92f0-4fb3-8717-f13dcd7963a7 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:08.321964 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-145a7dee-4ad9-42c7-8dd0-fcc87a767761 req-9586196d-92f0-4fb3-8717-f13dcd7963a7 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:08.335272 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-145a7dee-4ad9-42c7-8dd0-fcc87a767761 req-9586196d-92f0-4fb3-8717-f13dcd7963a7 service nova] Creating event network-vif-plugged:168733ef-a9ab-4b45-b7c7-dd94d6a8994b for instance 5a39d642-1c36-48cb-909b-751208990b95 on hv-cinder-maste Sep 18 01:02:08.341776 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-145a7dee-4ad9-42c7-8dd0-fcc87a767761 req-9586196d-92f0-4fb3-8717-f13dcd7963a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046146 Sep 18 01:02:08.342632 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 407/813] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:02:08.664648 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:08.665869 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:08.673616 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:08.674199 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:08.674715 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:08.675543 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:08.676078 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:08.676581 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:08.691923 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] HTTP exception thrown: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Request method failure captured: Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: DELETE /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c HTTP/1.1 Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmynEdNL7pAf1LovTldThupAVrePdjpWMxOnZKz4r-6pbCS15yBIvLlIATJ4grvojw4g5Raldgq6JL_4BlZSX21FYvBVnO9YPAVAttzmSKR5FH7h-tEAEcnxtuF-yTXEZYmZzhDe4A2PDTjtn66SZzhOc4zmSwuEzFRV0iiUIus1qgU Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:02:08.693751 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a60d2801df884e15be8a0464cb725d6d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}] Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 5e49a94877574c58aa4ff068b69a3dd6 Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:02:08.695204 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': 'abf6631e-213a-40ea-8708-5dc51da0ee8c'} Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:08.699165 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:02:08.700456 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:08.701683 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Returning 404 to user: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:08.701683 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-2f57bfb0-2060-4350-8d03-b1721c516648 tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 404 len: 111 microversion: 2.1 time: 0.034669 Sep 18 01:02:08.701683 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 407/814] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:02:08 2022] DELETE /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:08.705182 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:08.706095 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] [instance: abf6631e-213a-40ea-8708-5dc51da0ee8c] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:08.712480 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:08.713153 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:08.713603 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:08.714320 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:08.715360 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:08.715810 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:08.729430 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5b03e31f-19d1-49e7-a8fc-445e21725219 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:08.730045 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5b03e31f-19d1-49e7-a8fc-445e21725219 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:08.733178 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] HTTP exception thrown: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Request method failure captured: Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c HTTP/1.1 Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmynEdNL7pAf1LovTldThupAVrePdjpWMxOnZKz4r-6pbCS15yBIvLlIATJ4grvojw4g5Raldgq6JL_4BlZSX21FYvBVnO9YPAVAttzmSKR5FH7h-tEAEcnxtuF-yTXEZYmZzhDe4A2PDTjtn66SZzhOc4zmSwuEzFRV0iiUIus1qgU Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:02:08.735285 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a60d2801df884e15be8a0464cb725d6d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60d2801df884e15be8a0464cb725d6d"}]}] Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: a60d2801df884e15be8a0464cb725d6d Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1085881689 Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 5e49a94877574c58aa4ff068b69a3dd6 Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeTestJSON-1085881689-project Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:02:08.736848 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'abf6631e-213a-40ea-8708-5dc51da0ee8c'} Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:08.737756 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. Sep 18 01:02:08.739216 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:08.740797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5b03e31f-19d1-49e7-a8fc-445e21725219 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:08.740797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5b03e31f-19d1-49e7-a8fc-445e21725219 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:08.740797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5b03e31f-19d1-49e7-a8fc-445e21725219 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:08.740797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5b03e31f-19d1-49e7-a8fc-445e21725219 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:08.741148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5b03e31f-19d1-49e7-a8fc-445e21725219 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:08.741148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5b03e31f-19d1-49e7-a8fc-445e21725219 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:08.741982 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] Returning 404 to user: Instance abf6631e-213a-40ea-8708-5dc51da0ee8c could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:08.742921 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e081beeb-6b36-4cd8-bcf9-bb751fd4033b tempest-AttachVolumeTestJSON-1085881689 tempest-AttachVolumeTestJSON-1085881689-project] 10.222.0.33 "GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c" status: 404 len: 111 microversion: 2.1 time: 0.042280 Sep 18 01:02:08.743744 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 408/815] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:08 2022] GET /compute/v2.1/servers/abf6631e-213a-40ea-8708-5dc51da0ee8c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:08.888238 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5b03e31f-19d1-49e7-a8fc-445e21725219 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:08.900172 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5b03e31f-19d1-49e7-a8fc-445e21725219 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.174244 Sep 18 01:02:08.901825 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 408/816] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:08 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:09.128796 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:09.129621 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:09.135397 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:09.135874 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:09.136307 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:09.137664 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:09.138300 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:09.138726 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:09.388073 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:09.396290 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:09.397717 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:09.398910 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-25b392d2-76d1-402b-8744-2e6033807221 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.274060 Sep 18 01:02:09.399465 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 409/817] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:09 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:09.925042 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-feeb482d-3da5-4351-9d7a-a88fd1520d08 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:09.925654 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-feeb482d-3da5-4351-9d7a-a88fd1520d08 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:09.934842 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feeb482d-3da5-4351-9d7a-a88fd1520d08 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:09.935441 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feeb482d-3da5-4351-9d7a-a88fd1520d08 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:09.936137 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feeb482d-3da5-4351-9d7a-a88fd1520d08 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:09.937089 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feeb482d-3da5-4351-9d7a-a88fd1520d08 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:09.937790 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feeb482d-3da5-4351-9d7a-a88fd1520d08 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:09.938439 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feeb482d-3da5-4351-9d7a-a88fd1520d08 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:10.186916 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-feeb482d-3da5-4351-9d7a-a88fd1520d08 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:10.213422 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-feeb482d-3da5-4351-9d7a-a88fd1520d08 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.292187 Sep 18 01:02:10.220032 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 409/818] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:09 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:10.425419 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:10.426166 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:10.433101 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:10.436142 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:10.439575 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:10.439575 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:10.439575 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:10.439575 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:10.440035 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:10.639887 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:10.673310 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:10.676798 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:10.678041 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-906f13c7-cf45-4093-a0d0-deed01c0b634 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.256837 Sep 18 01:02:10.678608 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 410/819] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:10 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:11.242499 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9f224fb5-677a-49fd-a8eb-d84d0ce0acbd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:11.244662 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9f224fb5-677a-49fd-a8eb-d84d0ce0acbd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:11.252066 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f224fb5-677a-49fd-a8eb-d84d0ce0acbd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:11.252873 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f224fb5-677a-49fd-a8eb-d84d0ce0acbd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:11.253533 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f224fb5-677a-49fd-a8eb-d84d0ce0acbd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:11.254504 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f224fb5-677a-49fd-a8eb-d84d0ce0acbd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:11.255194 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f224fb5-677a-49fd-a8eb-d84d0ce0acbd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:11.255826 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9f224fb5-677a-49fd-a8eb-d84d0ce0acbd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:11.437838 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9f224fb5-677a-49fd-a8eb-d84d0ce0acbd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:11.447192 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9f224fb5-677a-49fd-a8eb-d84d0ce0acbd tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.209282 Sep 18 01:02:11.455628 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 410/820] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:11 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:11.710404 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:11.711049 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:11.722097 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:11.723433 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:11.724079 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:11.725020 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:11.725936 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:11.726587 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:11.743442 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:11.877610 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:11.885761 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:11.887749 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:11.889240 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f8db01a9-ee68-4e36-8d16-20ca1840e2fc tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.183975 Sep 18 01:02:11.889805 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 411/821] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:11 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:12.478176 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-03b74b91-180d-4203-a017-8fa7e2ab595e tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:12.481598 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-03b74b91-180d-4203-a017-8fa7e2ab595e tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:12.491652 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-03b74b91-180d-4203-a017-8fa7e2ab595e tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:12.492539 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-03b74b91-180d-4203-a017-8fa7e2ab595e tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:12.493330 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-03b74b91-180d-4203-a017-8fa7e2ab595e tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:12.494270 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-03b74b91-180d-4203-a017-8fa7e2ab595e tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:12.494930 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-03b74b91-180d-4203-a017-8fa7e2ab595e tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:12.500797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-03b74b91-180d-4203-a017-8fa7e2ab595e tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:12.634293 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-77b8c37a-b588-4c8b-9dae-6ffeb925f6a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:12.635927 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-77b8c37a-b588-4c8b-9dae-6ffeb925f6a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:12.650104 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77b8c37a-b588-4c8b-9dae-6ffeb925f6a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:12.650883 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77b8c37a-b588-4c8b-9dae-6ffeb925f6a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:12.651531 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77b8c37a-b588-4c8b-9dae-6ffeb925f6a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:12.659768 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77b8c37a-b588-4c8b-9dae-6ffeb925f6a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:12.662834 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77b8c37a-b588-4c8b-9dae-6ffeb925f6a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:12.663940 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-77b8c37a-b588-4c8b-9dae-6ffeb925f6a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:12.747487 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-03b74b91-180d-4203-a017-8fa7e2ab595e tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:12.752573 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-77b8c37a-b588-4c8b-9dae-6ffeb925f6a1 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/ips" status: 200 len: 149 microversion: 2.1 time: 0.122703 Sep 18 01:02:12.754007 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 412/822] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 18 01:02:12 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/ips => generated 149 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:12.758298 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-03b74b91-180d-4203-a017-8fa7e2ab595e tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.288725 Sep 18 01:02:12.758889 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 411/823] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:12 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:12.915937 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:12.916563 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:12.927469 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:12.928249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:12.930406 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:12.931350 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:12.933122 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:12.934526 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:13.122540 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:13.132363 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:13.135142 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:13.137065 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9f590746-19e6-4b2f-9bcb-d084eddd89f5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.225787 Sep 18 01:02:13.138392 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 413/824] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:12 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:13.782341 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-6799cd34-ded0-4fa4-bee7-0e46043a85db tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:13.783000 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-6799cd34-ded0-4fa4-bee7-0e46043a85db tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:13.790396 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6799cd34-ded0-4fa4-bee7-0e46043a85db tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:13.791011 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6799cd34-ded0-4fa4-bee7-0e46043a85db tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:13.791519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6799cd34-ded0-4fa4-bee7-0e46043a85db tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:13.792230 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6799cd34-ded0-4fa4-bee7-0e46043a85db tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:13.792778 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6799cd34-ded0-4fa4-bee7-0e46043a85db tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:13.793209 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-6799cd34-ded0-4fa4-bee7-0e46043a85db tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:13.997743 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-6799cd34-ded0-4fa4-bee7-0e46043a85db tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:14.021856 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-6799cd34-ded0-4fa4-bee7-0e46043a85db tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.243222 Sep 18 01:02:14.022471 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 412/825] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:13 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:14.164958 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:14.165740 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:14.174616 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:14.175641 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:14.176299 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:14.177167 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:14.177848 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:14.178281 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:14.329827 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:14.338035 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:14.340197 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:14.341733 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-716b92a2-589a-4ec3-9661-c97ab2295a47 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.182769 Sep 18 01:02:14.342352 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 414/826] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:14 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:14.496615 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-660735bd-06e8-42d5-a7ee-e6d955c9d859 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abf86365-cec0-43f2-818d-4879e8ac70e5"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:14.499917 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-660735bd-06e8-42d5-a7ee-e6d955c9d859 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:14.517106 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-660735bd-06e8-42d5-a7ee-e6d955c9d859 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:14.517599 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-660735bd-06e8-42d5-a7ee-e6d955c9d859 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:14.518030 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-660735bd-06e8-42d5-a7ee-e6d955c9d859 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:14.523144 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-660735bd-06e8-42d5-a7ee-e6d955c9d859 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:14.523612 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-660735bd-06e8-42d5-a7ee-e6d955c9d859 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:14.524164 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-660735bd-06e8-42d5-a7ee-e6d955c9d859 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:15.049577 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-eeafe37f-e715-458d-8d03-92efe44d64c5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:15.050190 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-eeafe37f-e715-458d-8d03-92efe44d64c5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:15.056092 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeafe37f-e715-458d-8d03-92efe44d64c5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:15.056581 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeafe37f-e715-458d-8d03-92efe44d64c5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:15.057014 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeafe37f-e715-458d-8d03-92efe44d64c5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:15.057713 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeafe37f-e715-458d-8d03-92efe44d64c5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:15.059003 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeafe37f-e715-458d-8d03-92efe44d64c5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:15.059438 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eeafe37f-e715-458d-8d03-92efe44d64c5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:15.204917 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-eeafe37f-e715-458d-8d03-92efe44d64c5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:15.212803 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-eeafe37f-e715-458d-8d03-92efe44d64c5 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.167079 Sep 18 01:02:15.213368 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 415/827] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:15 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:15.367115 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:15.367734 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:15.373673 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:15.374191 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:15.374588 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:15.375316 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:15.375773 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:15.376202 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:15.512147 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:15.523997 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:15.525584 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:15.527422 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c8f9fdd0-182e-47db-ac1e-f44e567c2ca0 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.164165 Sep 18 01:02:15.528048 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 416/828] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:15 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:02:16.236528 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c6966cf1-d29d-4523-964c-b54c37099c5d tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:16.237130 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c6966cf1-d29d-4523-964c-b54c37099c5d tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:16.243995 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c6966cf1-d29d-4523-964c-b54c37099c5d tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:16.244477 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c6966cf1-d29d-4523-964c-b54c37099c5d tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:16.244903 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c6966cf1-d29d-4523-964c-b54c37099c5d tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:16.246101 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c6966cf1-d29d-4523-964c-b54c37099c5d tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:16.246911 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c6966cf1-d29d-4523-964c-b54c37099c5d tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:16.247397 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c6966cf1-d29d-4523-964c-b54c37099c5d tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:16.433792 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c6966cf1-d29d-4523-964c-b54c37099c5d tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:16.441587 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c6966cf1-d29d-4523-964c-b54c37099c5d tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.208982 Sep 18 01:02:16.442155 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 417/829] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:16 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:16.553525 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:16.554255 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:16.560681 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:16.561237 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:16.561669 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:16.562368 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:16.562853 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:16.563277 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:16.760395 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:16.774198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:16.776536 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:16.777975 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c9b6de69-d34b-44fc-9a09-0252ba537607 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.228425 Sep 18 01:02:16.779515 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 418/830] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:16 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:02:16.848741 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-660735bd-06e8-42d5-a7ee-e6d955c9d859 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "POST /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.356924 Sep 18 01:02:16.850659 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 413/831] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 01:02:14 2022] POST /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-volume_attachments => generated 194 bytes in 2360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:17.465622 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e6e9a280-09bc-4bd8-8661-ff1894c547a1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:17.466899 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e6e9a280-09bc-4bd8-8661-ff1894c547a1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:17.474824 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6e9a280-09bc-4bd8-8661-ff1894c547a1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:17.475336 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6e9a280-09bc-4bd8-8661-ff1894c547a1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:17.475776 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6e9a280-09bc-4bd8-8661-ff1894c547a1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:17.476711 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6e9a280-09bc-4bd8-8661-ff1894c547a1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:17.477368 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6e9a280-09bc-4bd8-8661-ff1894c547a1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:17.478249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e6e9a280-09bc-4bd8-8661-ff1894c547a1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:17.671322 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e6e9a280-09bc-4bd8-8661-ff1894c547a1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:17.682402 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e6e9a280-09bc-4bd8-8661-ff1894c547a1 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.220483 Sep 18 01:02:17.683874 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 419/832] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:17 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:17.806299 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:17.807107 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:17.814483 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:17.815324 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:17.815987 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:17.816781 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:17.817315 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:17.817818 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:18.034880 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:18.043459 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:18.044904 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:18.046073 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c32d4f6e-522a-4873-8f97-af6e680f9efd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.244045 Sep 18 01:02:18.046643 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 414/833] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:17 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:18.705921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a2eeae4f-5012-4417-8217-cc3253468a77 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:18.707242 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-a2eeae4f-5012-4417-8217-cc3253468a77 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:18.716642 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a2eeae4f-5012-4417-8217-cc3253468a77 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:18.717136 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a2eeae4f-5012-4417-8217-cc3253468a77 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:18.717568 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a2eeae4f-5012-4417-8217-cc3253468a77 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:18.718589 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a2eeae4f-5012-4417-8217-cc3253468a77 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:18.719082 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a2eeae4f-5012-4417-8217-cc3253468a77 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:18.719510 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a2eeae4f-5012-4417-8217-cc3253468a77 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:18.875800 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a2eeae4f-5012-4417-8217-cc3253468a77 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:18.889129 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a2eeae4f-5012-4417-8217-cc3253468a77 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1574 microversion: 2.1 time: 0.186735 Sep 18 01:02:18.889784 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 420/834] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:18 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1574 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:19.072396 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:19.073003 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:19.079762 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:19.080262 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:19.080674 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:19.081358 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:19.081810 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:19.082235 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:19.209583 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:19.213069 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:19.219462 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:19.220891 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:19.222036 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b4f5ff27-d3ec-439a-8b31-922c6e3c8c1d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.153609 Sep 18 01:02:19.222589 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 415/835] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:19 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:19.912017 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-062f1cd9-2326-4281-963c-7080d50a3d29 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:19.912804 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-062f1cd9-2326-4281-963c-7080d50a3d29 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:19.920321 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-062f1cd9-2326-4281-963c-7080d50a3d29 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:19.921034 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-062f1cd9-2326-4281-963c-7080d50a3d29 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:19.921667 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-062f1cd9-2326-4281-963c-7080d50a3d29 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:19.922899 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-062f1cd9-2326-4281-963c-7080d50a3d29 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:19.923960 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-062f1cd9-2326-4281-963c-7080d50a3d29 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:19.925300 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-062f1cd9-2326-4281-963c-7080d50a3d29 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.071710 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-062f1cd9-2326-4281-963c-7080d50a3d29 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:20.080001 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-062f1cd9-2326-4281-963c-7080d50a3d29 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1561 microversion: 2.1 time: 0.171816 Sep 18 01:02:20.080586 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 421/836] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:19 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:20.248997 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:20.249872 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:20.347471 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.347471 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.347471 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.347471 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.349259 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.349259 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.366566 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-12fbf4f5-ae14-41e8-be54-417f09e867fb req-2d207e0c-3712-4855-9f76-f4e82e89f220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f4bab30-d9b2-4713-ab65-46a4754f8153", "name": "network-vif-plugged", "status": "completed", "tag": "41948106-b5ee-425d-bfed-b11f6d5cdb7e"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:20.381297 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-12fbf4f5-ae14-41e8-be54-417f09e867fb req-2d207e0c-3712-4855-9f76-f4e82e89f220 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.381797 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-12fbf4f5-ae14-41e8-be54-417f09e867fb req-2d207e0c-3712-4855-9f76-f4e82e89f220 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.382225 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-12fbf4f5-ae14-41e8-be54-417f09e867fb req-2d207e0c-3712-4855-9f76-f4e82e89f220 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.409433 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-12fbf4f5-ae14-41e8-be54-417f09e867fb req-2d207e0c-3712-4855-9f76-f4e82e89f220 service nova] Creating event network-vif-plugged:41948106-b5ee-425d-bfed-b11f6d5cdb7e for instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 on hv-cinder-maste Sep 18 01:02:20.413769 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:20.415535 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-12fbf4f5-ae14-41e8-be54-417f09e867fb req-2d207e0c-3712-4855-9f76-f4e82e89f220 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052697 Sep 18 01:02:20.416139 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 422/837] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:20.422268 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-73c5bc2d-db7e-40dd-8409-9f6345abf0c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:20.423414 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-73c5bc2d-db7e-40dd-8409-9f6345abf0c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:20.423518 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:20.425055 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:20.426394 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d5464d11-d1ab-436e-a05b-784e376ef375 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.182077 Sep 18 01:02:20.427272 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 416/838] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:20 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:20.429797 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73c5bc2d-db7e-40dd-8409-9f6345abf0c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.430292 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73c5bc2d-db7e-40dd-8409-9f6345abf0c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.430739 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73c5bc2d-db7e-40dd-8409-9f6345abf0c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.431466 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73c5bc2d-db7e-40dd-8409-9f6345abf0c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.431958 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73c5bc2d-db7e-40dd-8409-9f6345abf0c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.432406 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-73c5bc2d-db7e-40dd-8409-9f6345abf0c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.527136 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-73c5bc2d-db7e-40dd-8409-9f6345abf0c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lazy-loading 'services' on Instance uuid dc449a97-775f-4dad-8aa1-e12326cfdc88 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:02:20.600817 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-73c5bc2d-db7e-40dd-8409-9f6345abf0c0 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-volume_attachments/abf86365-cec0-43f2-818d-4879e8ac70e5" status: 202 len: 0 microversion: 2.1 time: 0.183090 Sep 18 01:02:20.601399 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 423/839] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 01:02:20 2022] DELETE /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-volume_attachments/abf86365-cec0-43f2-818d-4879e8ac70e5 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:02:20.610477 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8aef3b26-f1b8-434a-ac34-deb9d50ebc19 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:20.612785 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8aef3b26-f1b8-434a-ac34-deb9d50ebc19 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:20.619119 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8aef3b26-f1b8-434a-ac34-deb9d50ebc19 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.619751 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8aef3b26-f1b8-434a-ac34-deb9d50ebc19 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.621039 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8aef3b26-f1b8-434a-ac34-deb9d50ebc19 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.621936 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8aef3b26-f1b8-434a-ac34-deb9d50ebc19 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:20.622598 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8aef3b26-f1b8-434a-ac34-deb9d50ebc19 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:20.623053 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8aef3b26-f1b8-434a-ac34-deb9d50ebc19 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:20.654373 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8aef3b26-f1b8-434a-ac34-deb9d50ebc19 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048076 Sep 18 01:02:20.654872 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 417/840] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:02:20 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:21.454681 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:21.455542 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:21.461874 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:21.462412 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:21.462785 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:21.463527 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:21.464065 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:21.464488 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:21.595220 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:21.603357 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:21.605112 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:21.606272 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-cb3650b6-0f31-4bd3-9fbe-990323c3af36 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.156991 Sep 18 01:02:21.606839 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 424/841] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:21 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:02:21.666706 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-798e2016-a213-4689-988b-ed9d00791a20 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:21.669873 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-798e2016-a213-4689-988b-ed9d00791a20 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:21.672236 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:21.677594 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-798e2016-a213-4689-988b-ed9d00791a20 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:21.678104 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-798e2016-a213-4689-988b-ed9d00791a20 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:21.678537 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-798e2016-a213-4689-988b-ed9d00791a20 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:21.679266 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-798e2016-a213-4689-988b-ed9d00791a20 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:21.679723 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-798e2016-a213-4689-988b-ed9d00791a20 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:21.680147 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-798e2016-a213-4689-988b-ed9d00791a20 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:21.715965 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-798e2016-a213-4689-988b-ed9d00791a20 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053113 Sep 18 01:02:21.716738 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 418/842] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:02:21 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:22.632320 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:22.632994 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:22.640554 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:22.641206 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:22.641899 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:22.642664 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:22.643277 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:22.643811 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:22.732234 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a30dcbfa-171f-4131-9fae-ad4f798cb902 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:22.735898 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a30dcbfa-171f-4131-9fae-ad4f798cb902 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:22.744169 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30dcbfa-171f-4131-9fae-ad4f798cb902 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:22.745786 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30dcbfa-171f-4131-9fae-ad4f798cb902 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:22.746494 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30dcbfa-171f-4131-9fae-ad4f798cb902 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:22.747445 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30dcbfa-171f-4131-9fae-ad4f798cb902 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:22.747972 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30dcbfa-171f-4131-9fae-ad4f798cb902 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:22.748489 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a30dcbfa-171f-4131-9fae-ad4f798cb902 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:22.781969 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a30dcbfa-171f-4131-9fae-ad4f798cb902 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054237 Sep 18 01:02:22.782660 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 419/843] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:02:22 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:02:22.812110 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:22.826732 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:22.830051 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:22.831408 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8c0ef522-0afe-4b4d-a485-81ac4839e72a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.203365 Sep 18 01:02:22.832381 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 425/844] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:22 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:22.859330 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-0af34d32-9d65-4ac1-a688-031aa5281814 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:22.860096 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0af34d32-9d65-4ac1-a688-031aa5281814 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:22.866517 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0af34d32-9d65-4ac1-a688-031aa5281814 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:22.867042 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0af34d32-9d65-4ac1-a688-031aa5281814 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:22.867471 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0af34d32-9d65-4ac1-a688-031aa5281814 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:22.868164 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0af34d32-9d65-4ac1-a688-031aa5281814 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:22.868614 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0af34d32-9d65-4ac1-a688-031aa5281814 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:22.869042 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-0af34d32-9d65-4ac1-a688-031aa5281814 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:22.898771 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-0af34d32-9d65-4ac1-a688-031aa5281814 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Going to try to terminate instance {{(pid=120687) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:02:22.997570 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-0af34d32-9d65-4ac1-a688-031aa5281814 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 204 len: 0 microversion: 2.1 time: 0.135190 Sep 18 01:02:22.997570 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 420/845] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:02:22 2022] DELETE /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:02:23.002549 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-d8e49ec1-232d-4b78-b8ef-c7a82e0cf6c7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:23.003231 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-d8e49ec1-232d-4b78-b8ef-c7a82e0cf6c7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:23.009256 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8e49ec1-232d-4b78-b8ef-c7a82e0cf6c7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:23.009735 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8e49ec1-232d-4b78-b8ef-c7a82e0cf6c7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:23.010234 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8e49ec1-232d-4b78-b8ef-c7a82e0cf6c7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:23.011830 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8e49ec1-232d-4b78-b8ef-c7a82e0cf6c7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:23.012321 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8e49ec1-232d-4b78-b8ef-c7a82e0cf6c7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:23.012746 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-d8e49ec1-232d-4b78-b8ef-c7a82e0cf6c7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:23.151977 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-d8e49ec1-232d-4b78-b8ef-c7a82e0cf6c7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:23.159890 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-d8e49ec1-232d-4b78-b8ef-c7a82e0cf6c7 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1680 microversion: 2.1 time: 0.161453 Sep 18 01:02:23.160464 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 426/846] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:22 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:23.859120 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:23.859883 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:23.866507 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:23.867025 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:23.867457 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:23.868179 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:23.868637 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:23.869057 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:24.024622 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:24.033236 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:24.034629 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:24.035852 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9a290e42-78ef-484a-9e6c-c49bd3c2bb6a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1732 microversion: 2.20 time: 0.182058 Sep 18 01:02:24.036757 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 421/847] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:23 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:02:24.184340 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ca005477-3a9c-4064-a9ea-34c3c5c7a0a8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:24.184959 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ca005477-3a9c-4064-a9ea-34c3c5c7a0a8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:24.192458 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca005477-3a9c-4064-a9ea-34c3c5c7a0a8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:24.193091 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca005477-3a9c-4064-a9ea-34c3c5c7a0a8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:24.193565 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca005477-3a9c-4064-a9ea-34c3c5c7a0a8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:24.194362 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca005477-3a9c-4064-a9ea-34c3c5c7a0a8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:24.195083 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca005477-3a9c-4064-a9ea-34c3c5c7a0a8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:24.195678 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ca005477-3a9c-4064-a9ea-34c3c5c7a0a8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:24.336478 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ca005477-3a9c-4064-a9ea-34c3c5c7a0a8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:24.346741 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ca005477-3a9c-4064-a9ea-34c3c5c7a0a8 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1680 microversion: 2.1 time: 0.166577 Sep 18 01:02:24.347483 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 427/848] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:24 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:25.064799 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:25.066075 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:25.075610 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:25.076121 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:25.076709 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:25.077505 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:25.077976 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:25.078770 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:25.373869 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-97926e8f-5c3d-41ae-9e65-3aa240b4516c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:25.374693 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-97926e8f-5c3d-41ae-9e65-3aa240b4516c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:25.379768 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:25.381469 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-97926e8f-5c3d-41ae-9e65-3aa240b4516c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:25.382033 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-97926e8f-5c3d-41ae-9e65-3aa240b4516c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:25.382548 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-97926e8f-5c3d-41ae-9e65-3aa240b4516c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:25.383356 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-97926e8f-5c3d-41ae-9e65-3aa240b4516c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:25.383881 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-97926e8f-5c3d-41ae-9e65-3aa240b4516c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:25.384398 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-97926e8f-5c3d-41ae-9e65-3aa240b4516c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:25.388874 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:25.389424 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:25.390644 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:25.392054 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-09616166-1dfa-4310-93ea-088361aa53ea tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1719 microversion: 2.20 time: 0.331462 Sep 18 01:02:25.392650 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 422/849] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:25 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1719 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:02:25.647521 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-97926e8f-5c3d-41ae-9e65-3aa240b4516c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:25.655797 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-97926e8f-5c3d-41ae-9e65-3aa240b4516c tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1680 microversion: 2.1 time: 0.286387 Sep 18 01:02:25.656538 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 428/850] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:25 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1680 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:02:26.261138 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-79eb15e4-5424-47d8-a6f1-c2bb622e6322 req-df71c5dd-9d8c-43f9-a546-30428ca8dba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc449a97-775f-4dad-8aa1-e12326cfdc88", "name": "network-vif-deleted", "tag": "5716e21d-3ed3-4b50-ba82-2ad48f1eb0c2"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:02:26.273290 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-79eb15e4-5424-47d8-a6f1-c2bb622e6322 req-df71c5dd-9d8c-43f9-a546-30428ca8dba5 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:26.273783 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-79eb15e4-5424-47d8-a6f1-c2bb622e6322 req-df71c5dd-9d8c-43f9-a546-30428ca8dba5 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:26.274244 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-79eb15e4-5424-47d8-a6f1-c2bb622e6322 req-df71c5dd-9d8c-43f9-a546-30428ca8dba5 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:26.289348 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-79eb15e4-5424-47d8-a6f1-c2bb622e6322 req-df71c5dd-9d8c-43f9-a546-30428ca8dba5 service nova] Creating event network-vif-deleted:5716e21d-3ed3-4b50-ba82-2ad48f1eb0c2 for instance dc449a97-775f-4dad-8aa1-e12326cfdc88 on hv-cinder-maste Sep 18 01:02:26.296414 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-79eb15e4-5424-47d8-a6f1-c2bb622e6322 req-df71c5dd-9d8c-43f9-a546-30428ca8dba5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193756 Sep 18 01:02:26.297354 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 423/851] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:26.680314 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:26.680957 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:26.688546 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:26.689033 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:26.689472 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:26.690167 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:26.690625 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:26.691080 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:26.728371 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:26.728809 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:26.729703 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:26.730157 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lazy-loading 'fault' on Instance uuid dc449a97-775f-4dad-8aa1-e12326cfdc88 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:02:26.779574 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19ac9f3986640ae9b7993b98dd403c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d9e20d4ed4178b9bc68ff54715b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:26.790136 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3be9420f-95cf-481b-90f0-64da28c95523 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 200 len: 1331 microversion: 2.1 time: 0.113101 Sep 18 01:02:26.791094 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 429/852] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:26 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:27.814855 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:27.815487 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:27.822258 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:27.823414 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:27.824021 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:27.824712 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:27.825168 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:27.825591 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:27.839729 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 HTTP/1.1 Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:02:27.841804 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:27.843507 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': 'dc449a97-775f-4dad-8aa1-e12326cfdc88'} Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:27.844477 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:27.846050 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:27.847525 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:27.847525 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d649e609-643e-4808-9846-6e544c37f0b5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 404 len: 111 microversion: 2.1 time: 0.032818 Sep 18 01:02:27.847525 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 424/853] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:27 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:27.851921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e3ce3959-114f-4bc3-95f0-5883bdb3c002 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '.version_select at 0x7f56729513a0>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:27.870813 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e3ce3959-114f-4bc3-95f0-5883bdb3c002 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-541189452" status: 202 len: 0 microversion: 2.1 time: 0.022591 Sep 18 01:02:27.871384 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 430/854] 10.222.0.33 () {58 vars in 1218 bytes} [Sun Sep 18 01:02:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-541189452 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:02:29.636764 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:29.637397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:29.644280 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:29.644765 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:29.645407 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:29.646113 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:29.646574 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:29.647150 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:29.661590 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: DELETE /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 HTTP/1.1 Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:02:29.663220 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:29.664915 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': 'dc449a97-775f-4dad-8aa1-e12326cfdc88'} Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:29.665720 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:29.667111 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:29.668879 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:29.668879 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-685a0ded-aefb-4b7f-8f02-ba5055f1257a tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 404 len: 111 microversion: 2.1 time: 0.032494 Sep 18 01:02:29.668879 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 425/855] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:02:29 2022] DELETE /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:29.675019 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:29.675646 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: dc449a97-775f-4dad-8aa1-e12326cfdc88] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:29.683306 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:29.683808 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:29.684307 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:29.685038 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:29.685494 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:29.686268 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:29.700849 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 HTTP/1.1 Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:02:29.716559 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:29.718196 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'dc449a97-775f-4dad-8aa1-e12326cfdc88'} Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:29.719128 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. Sep 18 01:02:29.720612 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:29.722961 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance dc449a97-775f-4dad-8aa1-e12326cfdc88 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:29.724031 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-4b8eb184-c913-4192-9694-55410de19b8f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88" status: 404 len: 111 microversion: 2.1 time: 0.053407 Sep 18 01:02:29.724678 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 431/856] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:29 2022] GET /compute/v2.1/servers/dc449a97-775f-4dad-8aa1-e12326cfdc88 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:30.881416 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:30.881949 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:30.889233 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.889790 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.890237 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.890982 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.891450 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.891883 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.905794 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: DELETE /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 HTTP/1.1 Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:02:30.907518 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:02:30.908904 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '27162b19-b4be-4478-8644-79f59ff58586'} Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:30.909681 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:02:30.910995 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.913237 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:30.913237 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9542d883-daa2-40db-bf5c-b896295a7d7f tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 404 len: 111 microversion: 2.1 time: 0.031347 Sep 18 01:02:30.913237 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 426/857] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:02:30 2022] DELETE /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:30.918185 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:30.918825 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: 27162b19-b4be-4478-8644-79f59ff58586] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:30.925299 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.925795 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.926235 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.926966 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.927428 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.927856 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.941811 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 HTTP/1.1 Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:02:30.943410 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:02:30.944792 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '27162b19-b4be-4478-8644-79f59ff58586'} Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:30.945558 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. Sep 18 01:02:30.947020 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.948319 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance 27162b19-b4be-4478-8644-79f59ff58586 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:30.948319 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-4460f231-1dea-446e-83d8-815b4306bc89 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586" status: 404 len: 111 microversion: 2.1 time: 0.031899 Sep 18 01:02:30.948319 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 432/858] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:30 2022] GET /compute/v2.1/servers/27162b19-b4be-4478-8644-79f59ff58586 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:02:30.954289 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:30.954824 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:30.960718 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.961234 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.961858 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.962561 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.963049 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.963482 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.977553 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: DELETE /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b HTTP/1.1 Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:02:30.979164 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 01:02:30.981249 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': 'b142dfeb-6de9-4d35-9b1e-b0545715235b'} Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:30.982183 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 01:02:30.983835 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:30.985761 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:30.985761 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1e83a9f7-d232-460f-bec0-f0043219f223 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 404 len: 111 microversion: 2.1 time: 0.030518 Sep 18 01:02:30.985761 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 427/859] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:02:30 2022] DELETE /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:02:30.991024 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:30.991642 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: b142dfeb-6de9-4d35-9b1e-b0545715235b] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:30.998259 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:30.998739 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:30.999204 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:30.999911 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:31.000382 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:31.000816 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:31.014119 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b HTTP/1.1 Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:02:31.015694 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 01:02:31.017164 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'b142dfeb-6de9-4d35-9b1e-b0545715235b'} Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:31.017902 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. Sep 18 01:02:31.019159 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:31.020244 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance b142dfeb-6de9-4d35-9b1e-b0545715235b could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:31.020244 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-25cf31da-353f-4fb1-b992-fcd0cceba884 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b" status: 404 len: 111 microversion: 2.1 time: 0.031209 Sep 18 01:02:31.020244 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 433/860] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:30 2022] GET /compute/v2.1/servers/b142dfeb-6de9-4d35-9b1e-b0545715235b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 18 01:02:32.158227 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:32.158729 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:32.165062 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.165540 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.165972 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.167226 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.167693 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.168148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.181408 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: DELETE /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 HTTP/1.1 Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:02:32.183753 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 01:02:32.185276 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': 'e2055882-050f-4acf-a99c-96d698e25963'} Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:32.186043 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 01:02:32.187306 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:02:32.188796 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:32.188796 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a9fdf608-7b3c-40a9-97fc-717484da3813 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 404 len: 111 microversion: 2.1 time: 0.030761 Sep 18 01:02:32.188796 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 428/861] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:02:32 2022] DELETE /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:32.194175 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:32.194785 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] [instance: e2055882-050f-4acf-a99c-96d698e25963] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:32.201358 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.201816 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.202245 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.202976 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:32.203428 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:32.203843 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:32.217147 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] HTTP exception thrown: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Request method failure captured: Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 HTTP/1.1 Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmy0k8XCBofZ2RcJgMKi4V5FPfhFI-oiJeLQx72Oy2_uOY-_2WmWhc_R9D7Hk0jepHX-1-7Dswz85p0Gh2687gantT74eqObTQOg6nW_WKOk15hOxPlnIUWcNsj4t-nu-J6nO1yxlspd_WW8KX9kZe8uGTTw2QCUPvzKCEDo5H04V7A Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:02:32.218648 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec2d9e20d4ed4178b9bc68ff54715b18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec2d9e20d4ed4178b9bc68ff54715b18"}]}] Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: ec2d9e20d4ed4178b9bc68ff54715b18 Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855278435 Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: f19ac9f3986640ae9b7993b98dd403c0 Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeNegativeTest-855278435-project Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 01:02:32.220326 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'e2055882-050f-4acf-a99c-96d698e25963'} Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:02:32.221293 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. Sep 18 01:02:32.222831 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:02:32.224298 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] Returning 404 to user: Instance e2055882-050f-4acf-a99c-96d698e25963 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:02:32.224298 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f55dde3a-783a-45d6-b750-27d3abc788a5 tempest-AttachVolumeNegativeTest-855278435 tempest-AttachVolumeNegativeTest-855278435-project] 10.222.0.33 "GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963" status: 404 len: 111 microversion: 2.1 time: 0.030136 Sep 18 01:02:32.224298 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 434/862] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:02:32 2022] GET /compute/v2.1/servers/e2055882-050f-4acf-a99c-96d698e25963 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:38.035510 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9da00165-1a97-44a7-92c7-f7a9677420e4 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] Calling method '.version_select at 0x7f5672a914c0>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:38.085517 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9da00165-1a97-44a7-92c7-f7a9677420e4 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/ea06c424-c554-4ed5-9030-67d98de2ddb6" status: 200 len: 349 microversion: 2.1 time: 0.053664 Sep 18 01:02:38.086163 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 429/863] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 01:02:38 2022] GET /compute/v2.1/os-volumes/ea06c424-c554-4ed5-9030-67d98de2ddb6 => generated 349 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:39.437949 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f194c875-fbeb-4bf8-96f3-fffc5b3de1d2 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] Calling method '.version_select at 0x7f5672a1d670>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:39.486025 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f194c875-fbeb-4bf8-96f3-fffc5b3de1d2 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f77739fb-ac2b-4f71-9a1d-d40acf451902" status: 200 len: 351 microversion: 2.1 time: 0.052278 Sep 18 01:02:39.486588 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 435/864] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 01:02:39 2022] GET /compute/v2.1/os-volumes/f77739fb-ac2b-4f71-9a1d-d40acf451902 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:02:40.834531 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-75044311-7efb-4305-ad74-62e650308415 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] Calling method '.version_select at 0x7f56764a30d0>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:40.883032 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-75044311-7efb-4305-ad74-62e650308415 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f23adf66-859b-4993-9251-24afc0afa914" status: 200 len: 350 microversion: 2.1 time: 0.052691 Sep 18 01:02:40.883629 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 430/865] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 18 01:02:40 2022] GET /compute/v2.1/os-volumes/f23adf66-859b-4993-9251-24afc0afa914 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:40.897687 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2e5df22f-9442-4b92-a73e-7f1776115038 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] Calling method '.version_select at 0x7f567398df70>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:40.983495 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2e5df22f-9442-4b92-a73e-7f1776115038 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.089862 Sep 18 01:02:40.984191 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 436/866] 10.222.0.33 () {58 vars in 1134 bytes} [Sun Sep 18 01:02:40 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:40.999437 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5972b133-f40b-456e-ad23-d7c4a37d65aa tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] Calling method '.version_select at 0x7f56764a3700>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:41.085835 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5972b133-f40b-456e-ad23-d7c4a37d65aa tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090133 Sep 18 01:02:41.086566 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 431/867] 10.222.0.33 () {58 vars in 1149 bytes} [Sun Sep 18 01:02:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:41.100003 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2d632af3-e94e-4f3e-bd92-cf6583d11b45 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] Calling method '.version_select at 0x7f5672ba03a0>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:41.192043 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2d632af3-e94e-4f3e-bd92-cf6583d11b45 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.095688 Sep 18 01:02:41.192738 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 437/868] 10.222.0.33 () {58 vars in 1134 bytes} [Sun Sep 18 01:02:41 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:41.206099 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d585a012-37d3-41fb-baf0-4992634378fc tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] Calling method '.version_select at 0x7f56764a2670>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:41.293317 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d585a012-37d3-41fb-baf0-4992634378fc tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090645 Sep 18 01:02:41.294194 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 432/869] 10.222.0.33 () {58 vars in 1167 bytes} [Sun Sep 18 01:02:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:41.308330 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-cf4a6c01-a2dc-4f96-a5b5-c1b4f0ecd3e9 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] Calling method '.version_select at 0x7f5672a1d040>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:41.391352 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-cf4a6c01-a2dc-4f96-a5b5-c1b4f0ecd3e9 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086824 Sep 18 01:02:41.391927 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 438/870] 10.222.0.33 () {58 vars in 1170 bytes} [Sun Sep 18 01:02:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:02:41.406005 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-732ae84f-ee06-4da3-84a6-5e8f5f6a8637 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] Calling method '.version_select at 0x7f56729a2310>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:41.488254 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-732ae84f-ee06-4da3-84a6-5e8f5f6a8637 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.086174 Sep 18 01:02:41.489075 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 433/871] 10.222.0.33 () {58 vars in 1155 bytes} [Sun Sep 18 01:02:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:41.503708 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8f2ae2b4-5574-47ae-bbbc-61a11f86f6b9 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] Calling method '.version_select at 0x7f5672a73e50>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:41.587564 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8f2ae2b4-5574-47ae-bbbc-61a11f86f6b9 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088258 Sep 18 01:02:41.588679 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 439/872] 10.222.0.33 () {58 vars in 1188 bytes} [Sun Sep 18 01:02:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:02:41.602130 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-92e0a978-d086-4c28-86fb-fdeaa9373b47 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] Calling method '.version_select at 0x7f56764888b0>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:41.684005 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-92e0a978-d086-4c28-86fb-fdeaa9373b47 tempest-VolumesTestJSON-1516924934 tempest-VolumesTestJSON-1516924934-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085417 Sep 18 01:02:41.684573 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 434/873] 10.222.0.33 () {58 vars in 1155 bytes} [Sun Sep 18 01:02:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:58.565113 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:58.566634 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=20 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:58.574274 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-417a9cd9-b4d9-4ea1-9888-fd42885977bd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:58.574472 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-417a9cd9-b4d9-4ea1-9888-fd42885977bd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:58.583052 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-417a9cd9-b4d9-4ea1-9888-fd42885977bd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.583546 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-417a9cd9-b4d9-4ea1-9888-fd42885977bd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.584048 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-417a9cd9-b4d9-4ea1-9888-fd42885977bd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.584667 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-417a9cd9-b4d9-4ea1-9888-fd42885977bd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.585299 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-417a9cd9-b4d9-4ea1-9888-fd42885977bd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.586311 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-417a9cd9-b4d9-4ea1-9888-fd42885977bd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.636068 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-417a9cd9-b4d9-4ea1-9888-fd42885977bd tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.073879 Sep 18 01:02:58.636991 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 440/874] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 18 01:02:58 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:02:58.701691 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:58.702439 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:58.718654 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-026f943e-d5fe-4ed5-aaae-76bb6b800103 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:58.719580 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-026f943e-d5fe-4ed5-aaae-76bb6b800103 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:58.728394 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-026f943e-d5fe-4ed5-aaae-76bb6b800103 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.728887 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-026f943e-d5fe-4ed5-aaae-76bb6b800103 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.729327 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-026f943e-d5fe-4ed5-aaae-76bb6b800103 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.730071 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-026f943e-d5fe-4ed5-aaae-76bb6b800103 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.730537 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-026f943e-d5fe-4ed5-aaae-76bb6b800103 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.730994 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-026f943e-d5fe-4ed5-aaae-76bb6b800103 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.761643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-026f943e-d5fe-4ed5-aaae-76bb6b800103 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Going to try to terminate instance {{(pid=120687) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:02:58.848638 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-026f943e-d5fe-4ed5-aaae-76bb6b800103 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 204 len: 0 microversion: 2.20 time: 0.147935 Sep 18 01:02:58.849608 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 435/875] 10.222.0.33 () {60 vars in 1280 bytes} [Sun Sep 18 01:02:58 2022] DELETE /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:02:58.860403 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:02:58.861738 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:02:58.869619 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.870368 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.870891 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:58.871775 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:02:58.872365 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:02:58.872647 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:02:59.026666 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:59.037787 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:59.039863 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:02:59.041064 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-958ef203-e380-41e0-9fbc-0c40ab29335a tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.186460 Sep 18 01:02:59.041847 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 441/876] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:02:58 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 18 01:03:00.067503 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:00.068426 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:00.075381 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.076008 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.076345 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.077069 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:00.077520 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:00.077989 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:00.223433 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:00.233306 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:00.234739 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:00.239056 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-912a4af0-6db8-43ae-a43f-8c9acfc6d62b tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1725 microversion: 2.20 time: 0.173081 Sep 18 01:03:00.239056 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 436/877] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:00 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:01.263701 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:01.280935 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:01.295287 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:01.295782 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:01.296279 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:01.297156 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:01.298485 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:01.298717 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:01.408958 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:01.422351 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:01.424211 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1044cd9cbbe1497aae1939fe81f3f9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7f6c917c934c00a862b9946ce2b1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:01.425821 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-6f2c31e6-9f20-4090-bfc0-d1659cb0fc23 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 200 len: 1657 microversion: 2.20 time: 0.166238 Sep 18 01:03:01.427223 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 442/878] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:01 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 1657 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 18 01:03:01.643519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-164d4d60-a510-44a4-ab66-0e66e6133ea6 req-4438db8a-d7f5-4988-b65f-b34292df4439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f4bab30-d9b2-4713-ab65-46a4754f8153", "name": "network-vif-deleted", "tag": "41948106-b5ee-425d-bfed-b11f6d5cdb7e"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:01.653954 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-164d4d60-a510-44a4-ab66-0e66e6133ea6 req-4438db8a-d7f5-4988-b65f-b34292df4439 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:01.654440 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-164d4d60-a510-44a4-ab66-0e66e6133ea6 req-4438db8a-d7f5-4988-b65f-b34292df4439 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:01.655096 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-164d4d60-a510-44a4-ab66-0e66e6133ea6 req-4438db8a-d7f5-4988-b65f-b34292df4439 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:01.668305 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-164d4d60-a510-44a4-ab66-0e66e6133ea6 req-4438db8a-d7f5-4988-b65f-b34292df4439 service nova] Creating event network-vif-deleted:41948106-b5ee-425d-bfed-b11f6d5cdb7e for instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 on hv-cinder-maste Sep 18 01:03:01.678960 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-164d4d60-a510-44a4-ab66-0e66e6133ea6 req-4438db8a-d7f5-4988-b65f-b34292df4439 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039377 Sep 18 01:03:01.680493 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 437/879] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:02.452700 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:02.453156 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:02.460846 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:02.461606 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:02.462209 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:02.463143 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:02.463762 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:02.464193 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:02.486284 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] HTTP exception thrown: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Request method failure captured: Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 HTTP/1.1 Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmyuVGWRexS2PbnfIZVzHCEKEDuW80MAPn6A4iqmdaZYwgQ9r3ERbub_kLmtghXj_YX-Y0HG09NdARKXyoYCRfGNv3S6vRMmQnpQZ4M0IM2Ke86b4eRIZej5aBHmaOY4KcNRffe4X_y9tCdHNWColvCfjsYQEEorQt_MIrc75fB7M1M Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:03:02.488571 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a7f6c917c934c00a862b9946ce2b1cd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}] Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 1044cd9cbbe1497aae1939fe81f3f9a5 Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:02.490231 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '6f4bab30-d9b2-4713-ab65-46a4754f8153'} Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:02.491180 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:02.493241 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:02.495609 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Returning 404 to user: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:02.496679 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8df9d96e-949d-4683-b68c-ce8dd5f14743 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 404 len: 111 microversion: 2.20 time: 0.048093 Sep 18 01:03:02.501003 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 443/880] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:02 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:03:02.506930 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5c6d2161-ba85-475c-a502-34a297c9d6de tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '.version_select at 0x7f5672a144c0>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:02.531665 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5c6d2161-ba85-475c-a502-34a297c9d6de tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-157516840" status: 204 len: 0 microversion: 2.20 time: 0.029227 Sep 18 01:03:02.535782 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 438/881] 10.222.0.33 () {60 vars in 1259 bytes} [Sun Sep 18 01:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-157516840 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 18 01:03:03.915704 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1767567446", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452", "networks": [{"uuid": "165c2cd8-90b5-4ecf-83f8-2bbb22ae89b1"}]}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:03.986502 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.network.neutron [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] validate_networks() for [('165c2cd8-90b5-4ecf-83f8-2bbb22ae89b1', None, None, None, None, None)] {{(pid=120686) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:03:04.358811 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Flavor limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:03:04.359251 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Image limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:03:04.359907 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Flavor pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:03:04.360346 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Image pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:03:04.360979 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:03:04.371041 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.371562 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.372165 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.372915 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.373376 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.373807 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.392339 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Getting quotas for project 0a153c3fae624f67bfbc444bd46eeb70. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:04.396399 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Getting quotas for user 0c5b76707679442e900fe940f70c0273 and project 0a153c3fae624f67bfbc444bd46eeb70. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:04.407966 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Going to run 1 instances... {{(pid=120686) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:03:04.410671 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:03:04.464194 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b2b62269-dd1c-4bfe-8934-cbca2f33baa1 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688577 Sep 18 01:03:04.471631 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 444/882] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 01:03:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:03:04.478130 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-2ea2b846-8df0-4b2f-8ed4-c6e7c345d8f9 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:04.478898 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-2ea2b846-8df0-4b2f-8ed4-c6e7c345d8f9 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:04.552650 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-2ea2b846-8df0-4b2f-8ed4-c6e7c345d8f9 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:04.562432 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-2ea2b846-8df0-4b2f-8ed4-c6e7c345d8f9 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1214 microversion: 2.1 time: 0.089749 Sep 18 01:03:04.563664 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 439/883] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:04 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:03:04.619201 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:04.626633 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:04.637582 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.638361 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.639200 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.640095 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.640740 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.641382 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.662447 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] HTTP exception thrown: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Request method failure captured: Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: DELETE /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 HTTP/1.1 Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmyuVGWRexS2PbnfIZVzHCEKEDuW80MAPn6A4iqmdaZYwgQ9r3ERbub_kLmtghXj_YX-Y0HG09NdARKXyoYCRfGNv3S6vRMmQnpQZ4M0IM2Ke86b4eRIZej5aBHmaOY4KcNRffe4X_y9tCdHNWColvCfjsYQEEorQt_MIrc75fB7M1M Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:03:04.664713 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a7f6c917c934c00a862b9946ce2b1cd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}] Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 1044cd9cbbe1497aae1939fe81f3f9a5 Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:04.666161 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '6f4bab30-d9b2-4713-ab65-46a4754f8153'} Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:04.667040 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:04.668388 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.671081 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Returning 404 to user: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:04.672169 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0a0e5a8f-b147-4257-843d-8f1ceb38dbba tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 404 len: 111 microversion: 2.20 time: 0.072262 Sep 18 01:03:04.672801 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 445/884] 10.222.0.33 () {60 vars in 1280 bytes} [Sun Sep 18 01:03:04 2022] DELETE /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:03:04.684519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:04.685704 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: 6f4bab30-d9b2-4713-ab65-46a4754f8153] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:04.694161 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.694657 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.695900 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.696751 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:04.697651 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:04.698147 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:04.717492 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] HTTP exception thrown: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Request method failure captured: Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 HTTP/1.1 Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmyuVGWRexS2PbnfIZVzHCEKEDuW80MAPn6A4iqmdaZYwgQ9r3ERbub_kLmtghXj_YX-Y0HG09NdARKXyoYCRfGNv3S6vRMmQnpQZ4M0IM2Ke86b4eRIZej5aBHmaOY4KcNRffe4X_y9tCdHNWColvCfjsYQEEorQt_MIrc75fB7M1M Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:03:04.719485 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a7f6c917c934c00a862b9946ce2b1cd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}] Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 1044cd9cbbe1497aae1939fe81f3f9a5 Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:04.720982 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '6f4bab30-d9b2-4713-ab65-46a4754f8153'} Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:04.721763 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. Sep 18 01:03:04.723451 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:04.724599 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Returning 404 to user: Instance 6f4bab30-d9b2-4713-ab65-46a4754f8153 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:04.724599 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7194ee27-f950-4f4f-98f5-078f4439fac5 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153" status: 404 len: 111 microversion: 2.20 time: 0.043532 Sep 18 01:03:04.724599 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 440/885] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:04 2022] GET /compute/v2.1/servers/6f4bab30-d9b2-4713-ab65-46a4754f8153 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 18 01:03:05.595402 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-cf9a3b26-d3ac-4001-bc12-f58e68e22ea4 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:05.596059 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-cf9a3b26-d3ac-4001-bc12-f58e68e22ea4 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:05.605108 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf9a3b26-d3ac-4001-bc12-f58e68e22ea4 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.605602 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf9a3b26-d3ac-4001-bc12-f58e68e22ea4 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.606045 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf9a3b26-d3ac-4001-bc12-f58e68e22ea4 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.606759 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf9a3b26-d3ac-4001-bc12-f58e68e22ea4 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.607249 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf9a3b26-d3ac-4001-bc12-f58e68e22ea4 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.607676 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf9a3b26-d3ac-4001-bc12-f58e68e22ea4 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.682650 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-cf9a3b26-d3ac-4001-bc12-f58e68e22ea4 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:05.690628 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-cf9a3b26-d3ac-4001-bc12-f58e68e22ea4 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1266 microversion: 2.1 time: 0.099780 Sep 18 01:03:05.695302 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 446/886] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:05 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:05.921193 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:05.921714 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:05.928146 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.928632 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.929198 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.930460 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.930936 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.931416 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.945284 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] HTTP exception thrown: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Request method failure captured: Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: DELETE /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa HTTP/1.1 Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJmyuVGWRexS2PbnfIZVzHCEKEDuW80MAPn6A4iqmdaZYwgQ9r3ERbub_kLmtghXj_YX-Y0HG09NdARKXyoYCRfGNv3S6vRMmQnpQZ4M0IM2Ke86b4eRIZej5aBHmaOY4KcNRffe4X_y9tCdHNWColvCfjsYQEEorQt_MIrc75fB7M1M Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:03:05.946886 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a7f6c917c934c00a862b9946ce2b1cd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}] Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 1044cd9cbbe1497aae1939fe81f3f9a5 Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:03:05.948344 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': 'c1cf145a-d8d5-4a7e-937b-729bf79629fa'} Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:05.949123 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:03:05.950470 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:05.953763 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Returning 404 to user: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:05.953763 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-11e496f1-086f-4850-b1fc-8c2c73b9e60d tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 404 len: 111 microversion: 2.20 time: 0.030981 Sep 18 01:03:05.953763 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 441/887] 10.222.0.33 () {60 vars in 1280 bytes} [Sun Sep 18 01:03:05 2022] DELETE /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:03:05.956876 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:05.957487 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] [instance: c1cf145a-d8d5-4a7e-937b-729bf79629fa] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:05.963566 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.964060 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.964495 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.965400 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:05.966029 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:05.966657 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:05.983732 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] HTTP exception thrown: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Request method failure captured: Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa HTTP/1.1 Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJmyuVGWRexS2PbnfIZVzHCEKEDuW80MAPn6A4iqmdaZYwgQ9r3ERbub_kLmtghXj_YX-Y0HG09NdARKXyoYCRfGNv3S6vRMmQnpQZ4M0IM2Ke86b4eRIZej5aBHmaOY4KcNRffe4X_y9tCdHNWColvCfjsYQEEorQt_MIrc75fB7M1M Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Openstack-Nova-Api-Version: 2.20 Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:03:05.985518 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a7f6c917c934c00a862b9946ce2b1cd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a7f6c917c934c00a862b9946ce2b1cd"}]}] Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: 1a7f6c917c934c00a862b9946ce2b1cd Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1463204646 Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: 1044cd9cbbe1497aae1939fe81f3f9a5 Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1463204646-project Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:03:05.987333 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': 'c1cf145a-d8d5-4a7e-937b-729bf79629fa'} Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:05.988092 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. Sep 18 01:03:05.989335 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:05.990490 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] Returning 404 to user: Instance c1cf145a-d8d5-4a7e-937b-729bf79629fa could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:05.990490 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-1ab2b8fb-07a7-486d-b8d7-040699eb1841 tempest-AttachVolumeShelveTestJSON-1463204646 tempest-AttachVolumeShelveTestJSON-1463204646-project] 10.222.0.33 "GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa" status: 404 len: 111 microversion: 2.20 time: 0.033930 Sep 18 01:03:05.990490 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 447/888] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 18 01:03:05 2022] GET /compute/v2.1/servers/c1cf145a-d8d5-4a7e-937b-729bf79629fa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 18 01:03:06.716248 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-acaf849a-53bc-4651-9a35-1f3d43d50a97 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:06.717278 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-acaf849a-53bc-4651-9a35-1f3d43d50a97 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:06.732920 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acaf849a-53bc-4651-9a35-1f3d43d50a97 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:06.733777 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acaf849a-53bc-4651-9a35-1f3d43d50a97 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:06.734381 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acaf849a-53bc-4651-9a35-1f3d43d50a97 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:06.735115 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acaf849a-53bc-4651-9a35-1f3d43d50a97 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:06.735773 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acaf849a-53bc-4651-9a35-1f3d43d50a97 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:06.736438 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-acaf849a-53bc-4651-9a35-1f3d43d50a97 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:06.871725 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-acaf849a-53bc-4651-9a35-1f3d43d50a97 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:06.879717 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-acaf849a-53bc-4651-9a35-1f3d43d50a97 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1272 microversion: 2.1 time: 0.167492 Sep 18 01:03:06.880387 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 442/889] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:06 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:07.904031 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-e9ff5899-8b8a-4fd8-a755-33362ab239ba tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:07.905273 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-e9ff5899-8b8a-4fd8-a755-33362ab239ba tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:07.912047 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e9ff5899-8b8a-4fd8-a755-33362ab239ba tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:07.912788 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e9ff5899-8b8a-4fd8-a755-33362ab239ba tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:07.913435 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e9ff5899-8b8a-4fd8-a755-33362ab239ba tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:07.914361 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e9ff5899-8b8a-4fd8-a755-33362ab239ba tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:07.915043 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e9ff5899-8b8a-4fd8-a755-33362ab239ba tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:07.915477 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-e9ff5899-8b8a-4fd8-a755-33362ab239ba tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:07.966938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-a23a6f52-ae87-4f51-9845-ccf9d927d7dd req-40e38963-05cd-4675-90ce-f91697784aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6", "tag": "6a7302fd-f17a-4da0-8948-2181bd2154c4"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:07.988382 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-a23a6f52-ae87-4f51-9845-ccf9d927d7dd req-40e38963-05cd-4675-90ce-f91697784aca service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:07.989511 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-a23a6f52-ae87-4f51-9845-ccf9d927d7dd req-40e38963-05cd-4675-90ce-f91697784aca service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:07.990264 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-a23a6f52-ae87-4f51-9845-ccf9d927d7dd req-40e38963-05cd-4675-90ce-f91697784aca service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:08.006036 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-a23a6f52-ae87-4f51-9845-ccf9d927d7dd req-40e38963-05cd-4675-90ce-f91697784aca service nova] Creating event network-changed:6a7302fd-f17a-4da0-8948-2181bd2154c4 for instance 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 on hv-cinder-maste Sep 18 01:03:08.012831 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-a23a6f52-ae87-4f51-9845-ccf9d927d7dd req-40e38963-05cd-4675-90ce-f91697784aca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049713 Sep 18 01:03:08.013934 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 443/890] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:08.238832 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-e9ff5899-8b8a-4fd8-a755-33362ab239ba tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:08.254634 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-e9ff5899-8b8a-4fd8-a755-33362ab239ba tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1314 microversion: 2.1 time: 0.354306 Sep 18 01:03:08.255608 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 448/891] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:07 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:09.282544 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-f17617d6-ff75-4f19-9d4e-6f76c6b3e96a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:09.283384 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-f17617d6-ff75-4f19-9d4e-6f76c6b3e96a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:09.291282 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f17617d6-ff75-4f19-9d4e-6f76c6b3e96a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:09.291797 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f17617d6-ff75-4f19-9d4e-6f76c6b3e96a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:09.292306 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f17617d6-ff75-4f19-9d4e-6f76c6b3e96a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:09.293123 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f17617d6-ff75-4f19-9d4e-6f76c6b3e96a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:09.293657 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f17617d6-ff75-4f19-9d4e-6f76c6b3e96a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:09.294154 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-f17617d6-ff75-4f19-9d4e-6f76c6b3e96a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:09.729095 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-f17617d6-ff75-4f19-9d4e-6f76c6b3e96a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:09.738309 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-f17617d6-ff75-4f19-9d4e-6f76c6b3e96a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1314 microversion: 2.1 time: 0.462289 Sep 18 01:03:09.739146 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 444/892] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:09 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:10.761915 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7a853df3-f794-4081-a419-79f6492d07e0 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:10.762537 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7a853df3-f794-4081-a419-79f6492d07e0 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:10.769499 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7a853df3-f794-4081-a419-79f6492d07e0 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:10.769989 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7a853df3-f794-4081-a419-79f6492d07e0 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:10.770460 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7a853df3-f794-4081-a419-79f6492d07e0 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:10.771183 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7a853df3-f794-4081-a419-79f6492d07e0 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:10.771720 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7a853df3-f794-4081-a419-79f6492d07e0 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:10.772084 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7a853df3-f794-4081-a419-79f6492d07e0 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:10.906642 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7a853df3-f794-4081-a419-79f6492d07e0 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:10.915385 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7a853df3-f794-4081-a419-79f6492d07e0 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1314 microversion: 2.1 time: 0.158020 Sep 18 01:03:10.916182 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 449/893] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:10 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:03:11.940502 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-c6445bd8-f78b-440c-ab2f-88310fc0d75a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:11.941120 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-c6445bd8-f78b-440c-ab2f-88310fc0d75a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:11.948808 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6445bd8-f78b-440c-ab2f-88310fc0d75a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:11.949305 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6445bd8-f78b-440c-ab2f-88310fc0d75a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:11.949743 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6445bd8-f78b-440c-ab2f-88310fc0d75a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:11.950447 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6445bd8-f78b-440c-ab2f-88310fc0d75a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:11.951129 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6445bd8-f78b-440c-ab2f-88310fc0d75a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:11.951563 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-c6445bd8-f78b-440c-ab2f-88310fc0d75a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:12.132906 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-c6445bd8-f78b-440c-ab2f-88310fc0d75a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:12.140669 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-c6445bd8-f78b-440c-ab2f-88310fc0d75a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1314 microversion: 2.1 time: 0.204132 Sep 18 01:03:12.141229 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 445/894] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:11 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:03:12.644588 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-c3e59819-dcdf-4ddd-9177-7ad041cff884 req-d31dd288-0e5f-4d96-a449-521b3c8d97a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6", "name": "network-vif-plugged", "status": "completed", "tag": "6a7302fd-f17a-4da0-8948-2181bd2154c4"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:12.655694 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-c3e59819-dcdf-4ddd-9177-7ad041cff884 req-d31dd288-0e5f-4d96-a449-521b3c8d97a0 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:12.656292 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-c3e59819-dcdf-4ddd-9177-7ad041cff884 req-d31dd288-0e5f-4d96-a449-521b3c8d97a0 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:12.656728 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-c3e59819-dcdf-4ddd-9177-7ad041cff884 req-d31dd288-0e5f-4d96-a449-521b3c8d97a0 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:12.668520 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-c3e59819-dcdf-4ddd-9177-7ad041cff884 req-d31dd288-0e5f-4d96-a449-521b3c8d97a0 service nova] Creating event network-vif-plugged:6a7302fd-f17a-4da0-8948-2181bd2154c4 for instance 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 on hv-cinder-maste Sep 18 01:03:12.673536 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-c3e59819-dcdf-4ddd-9177-7ad041cff884 req-d31dd288-0e5f-4d96-a449-521b3c8d97a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032629 Sep 18 01:03:12.674172 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 450/895] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:13.163985 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-142d2e7e-9067-438f-945b-285e304ac6dd tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:13.164612 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-142d2e7e-9067-438f-945b-285e304ac6dd tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:13.173086 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-142d2e7e-9067-438f-945b-285e304ac6dd tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:13.173602 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-142d2e7e-9067-438f-945b-285e304ac6dd tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:13.174066 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-142d2e7e-9067-438f-945b-285e304ac6dd tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:13.174846 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-142d2e7e-9067-438f-945b-285e304ac6dd tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:13.175357 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-142d2e7e-9067-438f-945b-285e304ac6dd tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:13.175788 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-142d2e7e-9067-438f-945b-285e304ac6dd tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:13.318507 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-142d2e7e-9067-438f-945b-285e304ac6dd tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:13.326491 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-142d2e7e-9067-438f-945b-285e304ac6dd tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1314 microversion: 2.1 time: 0.166997 Sep 18 01:03:13.327107 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 446/896] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:13 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:14.352913 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-7d3f4457-1ee6-4b1b-ba71-e3360bf12877 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:14.353640 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-7d3f4457-1ee6-4b1b-ba71-e3360bf12877 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:14.359892 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7d3f4457-1ee6-4b1b-ba71-e3360bf12877 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:14.360380 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7d3f4457-1ee6-4b1b-ba71-e3360bf12877 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:14.360818 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7d3f4457-1ee6-4b1b-ba71-e3360bf12877 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:14.361776 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7d3f4457-1ee6-4b1b-ba71-e3360bf12877 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:14.362234 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7d3f4457-1ee6-4b1b-ba71-e3360bf12877 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:14.362660 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-7d3f4457-1ee6-4b1b-ba71-e3360bf12877 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:14.384173 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:14.403275 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=6 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:14.500501 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-7d3f4457-1ee6-4b1b-ba71-e3360bf12877 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:14.508397 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-7d3f4457-1ee6-4b1b-ba71-e3360bf12877 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1314 microversion: 2.1 time: 0.160734 Sep 18 01:03:14.509036 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 451/897] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:14 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:15.533612 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8d626f9c-143f-4070-99b5-2984ec0f697a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:15.534205 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8d626f9c-143f-4070-99b5-2984ec0f697a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:15.536672 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:15.543616 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8d626f9c-143f-4070-99b5-2984ec0f697a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:15.544122 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8d626f9c-143f-4070-99b5-2984ec0f697a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:15.544563 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8d626f9c-143f-4070-99b5-2984ec0f697a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:15.545278 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8d626f9c-143f-4070-99b5-2984ec0f697a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:15.545740 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8d626f9c-143f-4070-99b5-2984ec0f697a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:15.546167 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8d626f9c-143f-4070-99b5-2984ec0f697a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:15.676414 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8d626f9c-143f-4070-99b5-2984ec0f697a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:15.684961 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8d626f9c-143f-4070-99b5-2984ec0f697a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1499 microversion: 2.1 time: 0.155247 Sep 18 01:03:15.685522 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 447/898] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:15 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:18.463166 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f70f0c2f-d24d-454c-8487-6dfe7209148b tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:18.463774 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f70f0c2f-d24d-454c-8487-6dfe7209148b tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:18.470052 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f70f0c2f-d24d-454c-8487-6dfe7209148b tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:18.470543 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f70f0c2f-d24d-454c-8487-6dfe7209148b tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:18.471015 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f70f0c2f-d24d-454c-8487-6dfe7209148b tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:18.471715 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f70f0c2f-d24d-454c-8487-6dfe7209148b tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:18.472177 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f70f0c2f-d24d-454c-8487-6dfe7209148b tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:18.472607 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f70f0c2f-d24d-454c-8487-6dfe7209148b tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:18.498199 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f70f0c2f-d24d-454c-8487-6dfe7209148b tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Going to try to terminate instance {{(pid=120686) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:03:18.580340 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f70f0c2f-d24d-454c-8487-6dfe7209148b tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 204 len: 0 microversion: 2.1 time: 0.121214 Sep 18 01:03:18.581109 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 452/899] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:18 2022] DELETE /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:18.590141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-363119fc-8abb-4270-8489-94c66b685488 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:18.590763 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-363119fc-8abb-4270-8489-94c66b685488 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:18.597084 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-363119fc-8abb-4270-8489-94c66b685488 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:18.597575 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-363119fc-8abb-4270-8489-94c66b685488 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:18.598010 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-363119fc-8abb-4270-8489-94c66b685488 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:18.598705 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-363119fc-8abb-4270-8489-94c66b685488 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:18.599192 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-363119fc-8abb-4270-8489-94c66b685488 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:18.599621 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-363119fc-8abb-4270-8489-94c66b685488 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:18.734864 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-363119fc-8abb-4270-8489-94c66b685488 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:18.743004 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-363119fc-8abb-4270-8489-94c66b685488 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1505 microversion: 2.1 time: 0.157335 Sep 18 01:03:18.743658 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 448/900] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:18 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:19.766473 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-783cf32e-d104-4b3d-a1cb-8e7f8bef6115 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:19.767195 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-783cf32e-d104-4b3d-a1cb-8e7f8bef6115 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:19.773527 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-783cf32e-d104-4b3d-a1cb-8e7f8bef6115 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:19.774004 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-783cf32e-d104-4b3d-a1cb-8e7f8bef6115 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:19.774438 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-783cf32e-d104-4b3d-a1cb-8e7f8bef6115 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:19.775154 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-783cf32e-d104-4b3d-a1cb-8e7f8bef6115 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:19.775604 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-783cf32e-d104-4b3d-a1cb-8e7f8bef6115 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:19.776021 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-783cf32e-d104-4b3d-a1cb-8e7f8bef6115 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:19.924865 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-783cf32e-d104-4b3d-a1cb-8e7f8bef6115 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:19.934024 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-783cf32e-d104-4b3d-a1cb-8e7f8bef6115 tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1505 microversion: 2.1 time: 0.171783 Sep 18 01:03:19.934613 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 453/901] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:19 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:20.811305 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-ef9cb0ed-0c99-494f-8df7-4d241b062ca3 req-d4f1a1a7-45fe-4222-861e-9d87ec59c245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6", "name": "network-vif-deleted", "tag": "6a7302fd-f17a-4da0-8948-2181bd2154c4"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:20.823898 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ef9cb0ed-0c99-494f-8df7-4d241b062ca3 req-d4f1a1a7-45fe-4222-861e-9d87ec59c245 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:20.824419 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ef9cb0ed-0c99-494f-8df7-4d241b062ca3 req-d4f1a1a7-45fe-4222-861e-9d87ec59c245 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:20.824851 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-ef9cb0ed-0c99-494f-8df7-4d241b062ca3 req-d4f1a1a7-45fe-4222-861e-9d87ec59c245 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:20.837499 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-ef9cb0ed-0c99-494f-8df7-4d241b062ca3 req-d4f1a1a7-45fe-4222-861e-9d87ec59c245 service nova] Creating event network-vif-deleted:6a7302fd-f17a-4da0-8948-2181bd2154c4 for instance 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 on hv-cinder-maste Sep 18 01:03:20.842765 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-ef9cb0ed-0c99-494f-8df7-4d241b062ca3 req-d4f1a1a7-45fe-4222-861e-9d87ec59c245 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035066 Sep 18 01:03:20.843442 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 449/902] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:20.956432 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:20.957029 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:20.963792 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:20.964280 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:20.964711 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:20.965404 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:20.966070 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:20.966501 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:21.002022 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:21.002509 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:21.002970 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:21.003412 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lazy-loading 'fault' on Instance uuid 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:21.048083 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5b76707679442e900fe940f70c0273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a153c3fae624f67bfbc444bd46eeb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:21.056930 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0c80c57c-5eeb-4c03-8024-90851413c17d tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 200 len: 1304 microversion: 2.1 time: 0.104373 Sep 18 01:03:21.057566 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 454/903] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:20 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:22.081527 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:22.082912 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] [instance: 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:22.090768 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:22.091277 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:22.092591 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:22.092591 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:22.092872 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:22.093299 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:22.107810 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] HTTP exception thrown: Instance 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 could not be found. Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Request method failure captured: Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 HTTP/1.1 Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJm5Fp0S9hPhRqd-_MV_J1k5jDkKLJT2H1WbPZUmSETd3ft_8EUHeefDmoSXSmgFaiqmnb3agFLPoBoyqWpOq4xN9FailHcwIG1nTdpefbBGfV7eN34BUCdzChlgYgm_GZYbhAGIRzgOA0GJcL2jcTiMZA_zugHNN_UDRQsAj9uaLUyI Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: 0a153c3fae624f67bfbc444bd46eeb70 Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-VolumesActionsTest-1973087526 Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:03:22.109494 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a153c3fae624f67bfbc444bd46eeb70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a153c3fae624f67bfbc444bd46eeb70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a153c3fae624f67bfbc444bd46eeb70", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a153c3fae624f67bfbc444bd46eeb70"}]}] Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-VolumesActionsTest-1973087526 Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: 0a153c3fae624f67bfbc444bd46eeb70 Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-VolumesActionsTest-1973087526 Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-VolumesActionsTest-1973087526-project Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 0c5b76707679442e900fe940f70c0273 Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-VolumesActionsTest-1973087526-project Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 could not be found. Sep 18 01:03:22.111368 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6'} Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 could not be found. Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:22.112214 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 could not be found. Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 could not be found. Sep 18 01:03:22.113527 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:22.115527 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] Returning 404 to user: Instance 7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:22.117126 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1f5154fd-c61e-4b97-9a29-768190faa33a tempest-VolumesActionsTest-1973087526 tempest-VolumesActionsTest-1973087526-project] 10.222.0.33 "GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6" status: 404 len: 111 microversion: 2.1 time: 0.039259 Sep 18 01:03:22.117863 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 450/904] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:22 2022] GET /compute/v2.1/servers/7e2ad1f2-0c1c-4839-8eac-aefd4ee8eea6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:39.410287 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-648132211", "imageRef": "73511a79-1fd9-459e-82c6-5969c17465f5", "flavorRef": "452"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:39.420073 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:39.421103 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:39.490865 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.network.neutron [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] validate_networks() for None {{(pid=120686) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:03:39.608277 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b5a02072-6a33-47aa-a64f-c47867202fd4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:39.608785 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b5a02072-6a33-47aa-a64f-c47867202fd4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:39.611861 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:39.612525 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:39.622549 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5a02072-6a33-47aa-a64f-c47867202fd4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.623191 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5a02072-6a33-47aa-a64f-c47867202fd4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.623754 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5a02072-6a33-47aa-a64f-c47867202fd4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.624714 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5a02072-6a33-47aa-a64f-c47867202fd4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.625271 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5a02072-6a33-47aa-a64f-c47867202fd4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.625703 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b5a02072-6a33-47aa-a64f-c47867202fd4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.665771 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b5a02072-6a33-47aa-a64f-c47867202fd4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Going to try to terminate instance {{(pid=120687) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:03:39.778980 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b5a02072-6a33-47aa-a64f-c47867202fd4 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 204 len: 0 microversion: 2.1 time: 0.175297 Sep 18 01:03:39.780658 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 451/905] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:39 2022] DELETE /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:39.789030 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-737f5c47-dbe8-4fad-8452-c14e7fbc29fc req-082b448c-c0d0-425f-9a17-e4cdd9cdaef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a39d642-1c36-48cb-909b-751208990b95", "tag": "168733ef-a9ab-4b45-b7c7-dd94d6a8994b"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:39.805118 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-737f5c47-dbe8-4fad-8452-c14e7fbc29fc req-082b448c-c0d0-425f-9a17-e4cdd9cdaef8 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.805991 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-737f5c47-dbe8-4fad-8452-c14e7fbc29fc req-082b448c-c0d0-425f-9a17-e4cdd9cdaef8 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.806647 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-737f5c47-dbe8-4fad-8452-c14e7fbc29fc req-082b448c-c0d0-425f-9a17-e4cdd9cdaef8 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.820718 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-737f5c47-dbe8-4fad-8452-c14e7fbc29fc req-082b448c-c0d0-425f-9a17-e4cdd9cdaef8 service nova] Creating event network-changed:168733ef-a9ab-4b45-b7c7-dd94d6a8994b for instance 5a39d642-1c36-48cb-909b-751208990b95 on hv-cinder-maste Sep 18 01:03:39.827047 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-737f5c47-dbe8-4fad-8452-c14e7fbc29fc req-082b448c-c0d0-425f-9a17-e4cdd9cdaef8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045196 Sep 18 01:03:39.828006 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 452/906] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:39.831597 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Flavor limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:03:39.832047 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Image limits 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:03:39.832527 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Flavor pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:03:39.832945 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Image pref 0:0:0 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:03:39.833460 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.virt.hardware [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:03:39.835074 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-61ffc4c2-6e57-4668-a628-ac5371131142 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:39.835969 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-61ffc4c2-6e57-4668-a628-ac5371131142 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:39.842424 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-61ffc4c2-6e57-4668-a628-ac5371131142 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.842784 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.842993 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-61ffc4c2-6e57-4668-a628-ac5371131142 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.843318 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.843561 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-61ffc4c2-6e57-4668-a628-ac5371131142 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.843753 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.844076 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-61ffc4c2-6e57-4668-a628-ac5371131142 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.844542 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-61ffc4c2-6e57-4668-a628-ac5371131142 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.844676 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:39.844969 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-61ffc4c2-6e57-4668-a628-ac5371131142 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.845443 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:39.846018 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:39.870685 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Getting quotas for project 3260c1b9cf3343b0bd5c5f27aa13c499. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:03:39.876141 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Getting quotas for user e07feee48b874504b2b2ce7bd3cedb6c and project 3260c1b9cf3343b0bd5c5f27aa13c499. Resources: {'ram', 'instances', 'cores'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:03:39.889743 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Going to run 1 instances... {{(pid=120686) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:03:39.892436 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73511a79-1fd9-459e-82c6-5969c17465f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:03:39.948185 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8d8c8b66-6c04-42e1-9902-e65579fc0c7d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542454 Sep 18 01:03:39.949938 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 455/907] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 01:03:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 18 01:03:39.967370 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9b52e3ae-ae28-4cc8-9a43-60e3b3b60939 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:39.969988 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9b52e3ae-ae28-4cc8-9a43-60e3b3b60939 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:40.029829 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-61ffc4c2-6e57-4668-a628-ac5371131142 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:40.043069 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-61ffc4c2-6e57-4668-a628-ac5371131142 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.208041 Sep 18 01:03:40.044043 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 453/908] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:39 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:40.059504 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9b52e3ae-ae28-4cc8-9a43-60e3b3b60939 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:40.068430 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9b52e3ae-ae28-4cc8-9a43-60e3b3b60939 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1214 microversion: 2.1 time: 0.111533 Sep 18 01:03:40.069202 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 456/909] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:39 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:03:41.069073 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-92da1447-a968-4f38-9a96-1ee9d6ddcfc8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:41.069956 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-92da1447-a968-4f38-9a96-1ee9d6ddcfc8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:41.076941 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92da1447-a968-4f38-9a96-1ee9d6ddcfc8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:41.077435 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92da1447-a968-4f38-9a96-1ee9d6ddcfc8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:41.078090 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92da1447-a968-4f38-9a96-1ee9d6ddcfc8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:41.079409 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92da1447-a968-4f38-9a96-1ee9d6ddcfc8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:41.080250 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92da1447-a968-4f38-9a96-1ee9d6ddcfc8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:41.081035 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92da1447-a968-4f38-9a96-1ee9d6ddcfc8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:41.091175 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-5fe498d0-1b3e-4810-8331-40df8f6750cc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:41.091976 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-5fe498d0-1b3e-4810-8331-40df8f6750cc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:41.100008 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5fe498d0-1b3e-4810-8331-40df8f6750cc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:41.101380 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5fe498d0-1b3e-4810-8331-40df8f6750cc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:41.102089 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5fe498d0-1b3e-4810-8331-40df8f6750cc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:41.103085 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5fe498d0-1b3e-4810-8331-40df8f6750cc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:41.103729 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5fe498d0-1b3e-4810-8331-40df8f6750cc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:41.104486 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-5fe498d0-1b3e-4810-8331-40df8f6750cc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:41.207394 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-5fe498d0-1b3e-4810-8331-40df8f6750cc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:41.218807 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-5fe498d0-1b3e-4810-8331-40df8f6750cc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1218 microversion: 2.1 time: 0.131560 Sep 18 01:03:41.230357 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 457/910] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:41 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:41.296992 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-92da1447-a968-4f38-9a96-1ee9d6ddcfc8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:41.305292 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-92da1447-a968-4f38-9a96-1ee9d6ddcfc8 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1567 microversion: 2.1 time: 0.240082 Sep 18 01:03:41.305857 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 454/911] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:41 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:42.215565 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-92d27a21-90aa-4365-8b08-0d9509189de0 req-f1c201ff-a85f-4a6a-b340-dcdecf14d163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a39d642-1c36-48cb-909b-751208990b95", "name": "network-vif-deleted", "tag": "168733ef-a9ab-4b45-b7c7-dd94d6a8994b"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:42.242585 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8a49b2c3-e885-476c-8b13-195d740920de tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:42.243198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-92d27a21-90aa-4365-8b08-0d9509189de0 req-f1c201ff-a85f-4a6a-b340-dcdecf14d163 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:42.243198 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-92d27a21-90aa-4365-8b08-0d9509189de0 req-f1c201ff-a85f-4a6a-b340-dcdecf14d163 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:42.243403 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8a49b2c3-e885-476c-8b13-195d740920de tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:42.247386 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-92d27a21-90aa-4365-8b08-0d9509189de0 req-f1c201ff-a85f-4a6a-b340-dcdecf14d163 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:42.251324 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a49b2c3-e885-476c-8b13-195d740920de tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:42.251839 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a49b2c3-e885-476c-8b13-195d740920de tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:42.252264 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a49b2c3-e885-476c-8b13-195d740920de tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:42.252975 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a49b2c3-e885-476c-8b13-195d740920de tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:42.253437 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a49b2c3-e885-476c-8b13-195d740920de tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:42.253863 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8a49b2c3-e885-476c-8b13-195d740920de tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:42.274724 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-92d27a21-90aa-4365-8b08-0d9509189de0 req-f1c201ff-a85f-4a6a-b340-dcdecf14d163 service nova] Creating event network-vif-deleted:168733ef-a9ab-4b45-b7c7-dd94d6a8994b for instance 5a39d642-1c36-48cb-909b-751208990b95 on hv-cinder-maste Sep 18 01:03:42.284823 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-92d27a21-90aa-4365-8b08-0d9509189de0 req-f1c201ff-a85f-4a6a-b340-dcdecf14d163 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072993 Sep 18 01:03:42.285428 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 458/912] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:42.333386 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9b4bf2d5-50e4-4444-8f54-077dea1d2550 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:42.334426 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9b4bf2d5-50e4-4444-8f54-077dea1d2550 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:42.358123 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9b4bf2d5-50e4-4444-8f54-077dea1d2550 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:42.359098 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9b4bf2d5-50e4-4444-8f54-077dea1d2550 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:42.360004 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9b4bf2d5-50e4-4444-8f54-077dea1d2550 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:42.361279 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9b4bf2d5-50e4-4444-8f54-077dea1d2550 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:42.361998 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9b4bf2d5-50e4-4444-8f54-077dea1d2550 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:42.362491 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9b4bf2d5-50e4-4444-8f54-077dea1d2550 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:42.535788 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9b4bf2d5-50e4-4444-8f54-077dea1d2550 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b91804a3e840858e0dc695e8f1d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37316ddc7de431294eda723f5ef3f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:42.536451 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8a49b2c3-e885-476c-8b13-195d740920de tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:42.545044 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8a49b2c3-e885-476c-8b13-195d740920de tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1284 microversion: 2.1 time: 0.306538 Sep 18 01:03:42.545616 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 455/913] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:42 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1284 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:03:42.559022 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9b4bf2d5-50e4-4444-8f54-077dea1d2550 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 200 len: 1218 microversion: 2.1 time: 0.221033 Sep 18 01:03:42.559022 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 459/914] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:42 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 1218 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:43.571261 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-e792234b-92ad-49df-8d41-0209005bcc5f tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:43.571986 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-e792234b-92ad-49df-8d41-0209005bcc5f tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:43.579251 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e792234b-92ad-49df-8d41-0209005bcc5f tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.579743 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e792234b-92ad-49df-8d41-0209005bcc5f tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.580178 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e792234b-92ad-49df-8d41-0209005bcc5f tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:43.580879 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e792234b-92ad-49df-8d41-0209005bcc5f tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.581334 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e792234b-92ad-49df-8d41-0209005bcc5f tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.581755 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-e792234b-92ad-49df-8d41-0209005bcc5f tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:43.756178 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-e792234b-92ad-49df-8d41-0209005bcc5f tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:43.764733 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-e792234b-92ad-49df-8d41-0209005bcc5f tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1314 microversion: 2.1 time: 0.197765 Sep 18 01:03:43.765299 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 456/915] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:43 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:43.790899 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:43.791518 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] [instance: 5a39d642-1c36-48cb-909b-751208990b95] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:43.797651 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.798347 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.798923 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:43.799489 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:43.799941 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:43.800546 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:43.818331 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.wsgi [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] HTTP exception thrown: Instance 5a39d642-1c36-48cb-909b-751208990b95 could not be found. Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Request method failure captured: Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: request: GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 HTTP/1.1 Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept: application/json Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: Accept-Encoding: identity Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: Connection: close Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Length: 0 Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: Content-Type: application/json Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: Host: 10.222.0.33 Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: Openstack-System-Scope: None Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Auth-Token: gAAAAABjJm05f1RNR0kcgmhFI9XwpoaOb69RqjW3b4D2AWgnbKsS7esivwsOJNxy5XWp0ayoAvBgf-jH8JCnKdA0L-Tw59--TuIedViedHn3bHAPMyYwLvyCP6J435XWjId0Ozq2cx1qEi2qtWs4FRbRHFTzAcPVKFmxYqih9-NqGgIgheWWnnw Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Id: None Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Domain-Name: None Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Identity-Status: Confirmed Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Is-Admin-Project: True Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Id: default Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Domain-Name: Default Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Id: c37316ddc7de431294eda723f5ef3f60 Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Project-Name: tempest-TestShelveInstance-777148852 Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Role: reader,member Sep 18 01:03:43.821010 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Roles: reader,member Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c37316ddc7de431294eda723f5ef3f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c37316ddc7de431294eda723f5ef3f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c37316ddc7de431294eda723f5ef3f60", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c37316ddc7de431294eda723f5ef3f60"}]}] Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant: tempest-TestShelveInstance-777148852 Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Id: c37316ddc7de431294eda723f5ef3f60 Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-Tenant-Name: tempest-TestShelveInstance-777148852 Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User: tempest-TestShelveInstance-777148852-project Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Id: default Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Domain-Name: Default Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Id: a1b91804a3e840858e0dc695e8f1d89f Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: X-User-Name: tempest-TestShelveInstance-777148852-project Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: method: > Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: exception: Instance 5a39d642-1c36-48cb-909b-751208990b95 could not be found. Sep 18 01:03:43.822528 dv-cinder-master-3-smb devstack@n-api.service[120686]: action_args: {'id': '5a39d642-1c36-48cb-909b-751208990b95'} Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a39d642-1c36-48cb-909b-751208990b95 could not be found. Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:43.823961 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a39d642-1c36-48cb-909b-751208990b95 could not be found. Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a39d642-1c36-48cb-909b-751208990b95 could not be found. Sep 18 01:03:43.825348 dv-cinder-master-3-smb devstack@n-api.service[120686]: ERROR nova.api.openstack.wsgi Sep 18 01:03:43.827795 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Returning 404 to user: Instance 5a39d642-1c36-48cb-909b-751208990b95 could not be found. {{(pid=120686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:43.827795 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f3a8e9db-860f-4c73-8d66-56f11cbc908a tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95" status: 404 len: 111 microversion: 2.1 time: 0.255494 Sep 18 01:03:43.827795 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 460/916] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:43 2022] GET /compute/v2.1/servers/5a39d642-1c36-48cb-909b-751208990b95 => generated 111 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:03:44.014392 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a522fbef-6e4b-454d-97cc-978e05a26ff3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] Calling method '.version_select at 0x7f5672a46670>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:44.040608 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a522fbef-6e4b-454d-97cc-978e05a26ff3 tempest-TestShelveInstance-777148852 tempest-TestShelveInstance-777148852-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-560900150" status: 202 len: 0 microversion: 2.1 time: 0.029962 Sep 18 01:03:44.041217 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 457/917] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 18 01:03:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-560900150 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:03:44.447067 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-5e287e4a-170b-4d70-8e0e-82ec9432e834 req-85f40131-c8c6-4f99-8fd7-e75a5092a7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55dd5398-3040-4d30-b51b-62c056ce2619", "tag": "a1ea49d1-67fb-46e9-b81d-3f06e39ed050"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:44.458573 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-5e287e4a-170b-4d70-8e0e-82ec9432e834 req-85f40131-c8c6-4f99-8fd7-e75a5092a7c1 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.459092 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-5e287e4a-170b-4d70-8e0e-82ec9432e834 req-85f40131-c8c6-4f99-8fd7-e75a5092a7c1 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.459660 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-5e287e4a-170b-4d70-8e0e-82ec9432e834 req-85f40131-c8c6-4f99-8fd7-e75a5092a7c1 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.474135 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-5e287e4a-170b-4d70-8e0e-82ec9432e834 req-85f40131-c8c6-4f99-8fd7-e75a5092a7c1 service nova] Creating event network-changed:a1ea49d1-67fb-46e9-b81d-3f06e39ed050 for instance 55dd5398-3040-4d30-b51b-62c056ce2619 on hv-cinder-maste Sep 18 01:03:44.494300 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-5e287e4a-170b-4d70-8e0e-82ec9432e834 req-85f40131-c8c6-4f99-8fd7-e75a5092a7c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051668 Sep 18 01:03:44.495009 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 461/918] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:44.794821 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a3c8ab30-a129-4be6-9fcc-f89740e8f4bc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:44.795521 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a3c8ab30-a129-4be6-9fcc-f89740e8f4bc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:44.808160 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a3c8ab30-a129-4be6-9fcc-f89740e8f4bc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.808846 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a3c8ab30-a129-4be6-9fcc-f89740e8f4bc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.809376 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a3c8ab30-a129-4be6-9fcc-f89740e8f4bc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:44.810149 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a3c8ab30-a129-4be6-9fcc-f89740e8f4bc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:44.810700 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a3c8ab30-a129-4be6-9fcc-f89740e8f4bc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:44.811213 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a3c8ab30-a129-4be6-9fcc-f89740e8f4bc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:45.045195 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a3c8ab30-a129-4be6-9fcc-f89740e8f4bc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:45.053001 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a3c8ab30-a129-4be6-9fcc-f89740e8f4bc tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1314 microversion: 2.1 time: 0.263002 Sep 18 01:03:45.053738 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 458/919] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:44 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:46.077551 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-78e5c2e3-924b-4f68-864d-153bb9ca3cda tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:46.078258 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-78e5c2e3-924b-4f68-864d-153bb9ca3cda tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:46.084700 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78e5c2e3-924b-4f68-864d-153bb9ca3cda tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.085234 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78e5c2e3-924b-4f68-864d-153bb9ca3cda tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.086037 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78e5c2e3-924b-4f68-864d-153bb9ca3cda tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.086834 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78e5c2e3-924b-4f68-864d-153bb9ca3cda tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:46.087451 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78e5c2e3-924b-4f68-864d-153bb9ca3cda tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:46.088037 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-78e5c2e3-924b-4f68-864d-153bb9ca3cda tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:46.249123 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-78e5c2e3-924b-4f68-864d-153bb9ca3cda tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:46.257478 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-78e5c2e3-924b-4f68-864d-153bb9ca3cda tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1314 microversion: 2.1 time: 0.185700 Sep 18 01:03:46.258154 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 462/920] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:46 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:47.280211 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-8cc1a3dc-bd0f-493f-9de7-d3ce320f7f16 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:47.281445 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-8cc1a3dc-bd0f-493f-9de7-d3ce320f7f16 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:47.293537 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cc1a3dc-bd0f-493f-9de7-d3ce320f7f16 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:47.294055 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cc1a3dc-bd0f-493f-9de7-d3ce320f7f16 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:47.294495 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cc1a3dc-bd0f-493f-9de7-d3ce320f7f16 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:47.295571 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cc1a3dc-bd0f-493f-9de7-d3ce320f7f16 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:47.296205 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cc1a3dc-bd0f-493f-9de7-d3ce320f7f16 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:47.296972 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-8cc1a3dc-bd0f-493f-9de7-d3ce320f7f16 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:47.531887 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-8cc1a3dc-bd0f-493f-9de7-d3ce320f7f16 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:47.540563 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-8cc1a3dc-bd0f-493f-9de7-d3ce320f7f16 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1314 microversion: 2.1 time: 0.264419 Sep 18 01:03:47.541505 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 459/921] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:47 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:48.564128 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3cb724d2-f37f-42ff-81e8-7b0360961af0 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:48.564708 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3cb724d2-f37f-42ff-81e8-7b0360961af0 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:48.571818 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cb724d2-f37f-42ff-81e8-7b0360961af0 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:48.572308 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cb724d2-f37f-42ff-81e8-7b0360961af0 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:48.572749 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cb724d2-f37f-42ff-81e8-7b0360961af0 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:48.573460 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cb724d2-f37f-42ff-81e8-7b0360961af0 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:48.573924 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cb724d2-f37f-42ff-81e8-7b0360961af0 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:48.574355 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3cb724d2-f37f-42ff-81e8-7b0360961af0 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:48.716411 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3cb724d2-f37f-42ff-81e8-7b0360961af0 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:48.728689 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3cb724d2-f37f-42ff-81e8-7b0360961af0 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1314 microversion: 2.1 time: 0.168601 Sep 18 01:03:48.729900 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 463/922] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:48 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:48.835937 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-092cc65e-043b-42f5-8368-c3e8eb88c66b req-e979111d-fbc1-4a18-8086-f91bbcdd7986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55dd5398-3040-4d30-b51b-62c056ce2619", "name": "network-vif-plugged", "status": "completed", "tag": "a1ea49d1-67fb-46e9-b81d-3f06e39ed050"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:48.846873 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-092cc65e-043b-42f5-8368-c3e8eb88c66b req-e979111d-fbc1-4a18-8086-f91bbcdd7986 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:48.847694 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-092cc65e-043b-42f5-8368-c3e8eb88c66b req-e979111d-fbc1-4a18-8086-f91bbcdd7986 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:48.848403 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-092cc65e-043b-42f5-8368-c3e8eb88c66b req-e979111d-fbc1-4a18-8086-f91bbcdd7986 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:48.860587 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-092cc65e-043b-42f5-8368-c3e8eb88c66b req-e979111d-fbc1-4a18-8086-f91bbcdd7986 service nova] Creating event network-vif-plugged:a1ea49d1-67fb-46e9-b81d-3f06e39ed050 for instance 55dd5398-3040-4d30-b51b-62c056ce2619 on hv-cinder-maste Sep 18 01:03:48.866293 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-092cc65e-043b-42f5-8368-c3e8eb88c66b req-e979111d-fbc1-4a18-8086-f91bbcdd7986 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034376 Sep 18 01:03:48.867278 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 460/923] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:49.753745 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-947f8869-8a04-4d4b-90db-fb979d1a9387 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:49.754375 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-947f8869-8a04-4d4b-90db-fb979d1a9387 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:49.762493 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-947f8869-8a04-4d4b-90db-fb979d1a9387 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.763044 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-947f8869-8a04-4d4b-90db-fb979d1a9387 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.763526 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-947f8869-8a04-4d4b-90db-fb979d1a9387 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.764433 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-947f8869-8a04-4d4b-90db-fb979d1a9387 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:49.764896 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-947f8869-8a04-4d4b-90db-fb979d1a9387 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:49.765379 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-947f8869-8a04-4d4b-90db-fb979d1a9387 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:49.856383 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=2 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:49.905405 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-947f8869-8a04-4d4b-90db-fb979d1a9387 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:49.914176 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-947f8869-8a04-4d4b-90db-fb979d1a9387 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1314 microversion: 2.1 time: 0.164701 Sep 18 01:03:49.914759 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 464/924] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:49 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:50.938545 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-960e1b96-a50a-4a40-8273-489df669f70b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:50.939286 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-960e1b96-a50a-4a40-8273-489df669f70b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:50.945442 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960e1b96-a50a-4a40-8273-489df669f70b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:50.945932 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960e1b96-a50a-4a40-8273-489df669f70b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:50.946560 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960e1b96-a50a-4a40-8273-489df669f70b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:50.947466 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960e1b96-a50a-4a40-8273-489df669f70b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:50.947938 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960e1b96-a50a-4a40-8273-489df669f70b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:50.948365 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-960e1b96-a50a-4a40-8273-489df669f70b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.183704 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-960e1b96-a50a-4a40-8273-489df669f70b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:51.202781 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-960e1b96-a50a-4a40-8273-489df669f70b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1463 microversion: 2.1 time: 0.268949 Sep 18 01:03:51.203401 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 461/925] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:50 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1463 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:51.258755 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-51c412fa-8b60-41b7-a285-e26a7b07ed5d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:51.259934 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-51c412fa-8b60-41b7-a285-e26a7b07ed5d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:51.262265 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=8 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:03:51.272399 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51c412fa-8b60-41b7-a285-e26a7b07ed5d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.273189 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51c412fa-8b60-41b7-a285-e26a7b07ed5d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.273708 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51c412fa-8b60-41b7-a285-e26a7b07ed5d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.274346 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51c412fa-8b60-41b7-a285-e26a7b07ed5d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.275064 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51c412fa-8b60-41b7-a285-e26a7b07ed5d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.276011 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-51c412fa-8b60-41b7-a285-e26a7b07ed5d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.320381 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-51c412fa-8b60-41b7-a285-e26a7b07ed5d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Going to try to terminate instance {{(pid=120686) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:03:51.426223 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-51c412fa-8b60-41b7-a285-e26a7b07ed5d tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 204 len: 0 microversion: 2.1 time: 0.171619 Sep 18 01:03:51.427489 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 465/926] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:03:51 2022] DELETE /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:03:51.436048 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1ff92432-cfdf-46ce-aa31-3d153b04c64b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:51.436978 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1ff92432-cfdf-46ce-aa31-3d153b04c64b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:51.444171 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ff92432-cfdf-46ce-aa31-3d153b04c64b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.445139 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ff92432-cfdf-46ce-aa31-3d153b04c64b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.448108 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ff92432-cfdf-46ce-aa31-3d153b04c64b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.449144 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ff92432-cfdf-46ce-aa31-3d153b04c64b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:51.454350 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ff92432-cfdf-46ce-aa31-3d153b04c64b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:51.454350 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1ff92432-cfdf-46ce-aa31-3d153b04c64b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:51.718865 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1ff92432-cfdf-46ce-aa31-3d153b04c64b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:51.733554 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1ff92432-cfdf-46ce-aa31-3d153b04c64b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1469 microversion: 2.1 time: 0.301579 Sep 18 01:03:51.735025 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 462/927] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:51 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:52.764042 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-cf06e8d5-32e5-4596-80cc-409ca4286976 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:52.764891 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-cf06e8d5-32e5-4596-80cc-409ca4286976 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:52.772924 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf06e8d5-32e5-4596-80cc-409ca4286976 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.773529 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf06e8d5-32e5-4596-80cc-409ca4286976 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.774094 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf06e8d5-32e5-4596-80cc-409ca4286976 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.774967 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf06e8d5-32e5-4596-80cc-409ca4286976 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:52.775489 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf06e8d5-32e5-4596-80cc-409ca4286976 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:52.775976 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-cf06e8d5-32e5-4596-80cc-409ca4286976 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:52.926784 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-cf06e8d5-32e5-4596-80cc-409ca4286976 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:52.935635 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-cf06e8d5-32e5-4596-80cc-409ca4286976 tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1469 microversion: 2.1 time: 0.176056 Sep 18 01:03:52.936657 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 466/928] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:52 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:03:53.630269 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-2ecbec78-14cb-45e9-a57a-428ff4250e95 req-5b1d8bb0-0954-4e45-b490-48aad7076db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55dd5398-3040-4d30-b51b-62c056ce2619", "name": "network-vif-deleted", "tag": "a1ea49d1-67fb-46e9-b81d-3f06e39ed050"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:03:53.646811 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-2ecbec78-14cb-45e9-a57a-428ff4250e95 req-5b1d8bb0-0954-4e45-b490-48aad7076db5 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.647600 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-2ecbec78-14cb-45e9-a57a-428ff4250e95 req-5b1d8bb0-0954-4e45-b490-48aad7076db5 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.648147 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-2ecbec78-14cb-45e9-a57a-428ff4250e95 req-5b1d8bb0-0954-4e45-b490-48aad7076db5 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.663745 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-2ecbec78-14cb-45e9-a57a-428ff4250e95 req-5b1d8bb0-0954-4e45-b490-48aad7076db5 service nova] Creating event network-vif-deleted:a1ea49d1-67fb-46e9-b81d-3f06e39ed050 for instance 55dd5398-3040-4d30-b51b-62c056ce2619 on hv-cinder-maste Sep 18 01:03:53.669295 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-2ecbec78-14cb-45e9-a57a-428ff4250e95 req-5b1d8bb0-0954-4e45-b490-48aad7076db5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042737 Sep 18 01:03:53.675201 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 463/929] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:03:53.959488 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:53.960101 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:53.966280 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.966777 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.967242 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:53.967975 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:53.968432 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:53.968890 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:54.007621 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:54.008144 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:54.009003 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:54.009662 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.objects.instance [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lazy-loading 'fault' on Instance uuid 55dd5398-3040-4d30-b51b-62c056ce2619 {{(pid=120686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:03:54.051621 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07feee48b874504b2b2ce7bd3cedb6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3260c1b9cf3343b0bd5c5f27aa13c499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:03:54.060617 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-21757578-2155-41f7-9367-2fb3171a596a tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 200 len: 1304 microversion: 2.1 time: 0.105278 Sep 18 01:03:54.061286 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 467/930] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:53 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:03:55.086208 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:03:55.086919 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] [instance: 55dd5398-3040-4d30-b51b-62c056ce2619] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:03:55.093149 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.093645 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.094089 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.094811 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:03:55.095284 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:03:55.095715 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:03:55.109875 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] HTTP exception thrown: Instance 55dd5398-3040-4d30-b51b-62c056ce2619 could not be found. Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Request method failure captured: Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 HTTP/1.1 Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJm5pTX0YxXZuUnURrUUetOJxIwUOYLcI88EuwiZN3dou4H94iNNk-8ZMMt_6QHt-iNz_4NAt2EePbAO2WHeWEXDeCMhJ2MqTsmk8cWopxx6NIfBFFLUWQgz2rY_yXqI0aDcwntc0Q43JTip1qD_hUEjG59ou5s12B5dLK-kBTGuTQHQ Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: 3260c1b9cf3343b0bd5c5f27aa13c499 Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-VolumesNegativeTest-114247925 Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:03:55.111533 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3260c1b9cf3343b0bd5c5f27aa13c499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3260c1b9cf3343b0bd5c5f27aa13c499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3260c1b9cf3343b0bd5c5f27aa13c499", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3260c1b9cf3343b0bd5c5f27aa13c499"}]}] Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-VolumesNegativeTest-114247925 Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: 3260c1b9cf3343b0bd5c5f27aa13c499 Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-VolumesNegativeTest-114247925 Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-VolumesNegativeTest-114247925-project Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: e07feee48b874504b2b2ce7bd3cedb6c Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-VolumesNegativeTest-114247925-project Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance 55dd5398-3040-4d30-b51b-62c056ce2619 could not be found. Sep 18 01:03:55.113260 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '55dd5398-3040-4d30-b51b-62c056ce2619'} Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55dd5398-3040-4d30-b51b-62c056ce2619 could not be found. Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:03:55.114259 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55dd5398-3040-4d30-b51b-62c056ce2619 could not be found. Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55dd5398-3040-4d30-b51b-62c056ce2619 could not be found. Sep 18 01:03:55.116272 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:03:55.117488 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] Returning 404 to user: Instance 55dd5398-3040-4d30-b51b-62c056ce2619 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:03:55.117488 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5da12efd-436c-4417-9950-a8f60cb8463b tempest-VolumesNegativeTest-114247925 tempest-VolumesNegativeTest-114247925-project] 10.222.0.33 "GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619" status: 404 len: 111 microversion: 2.1 time: 0.031935 Sep 18 01:03:55.117488 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 464/931] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:03:55 2022] GET /compute/v2.1/servers/55dd5398-3040-4d30-b51b-62c056ce2619 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:19.058963 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-1b599dcf-0821-428f-87a9-4b0a60e489f8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Action: 'create', calling method: .version_select at 0x7f56729d1ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-610239297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNr5Ot/qzZFoBiS0cpU+xuF1wb/aaPLEOa9SQyCEIIuBTehT1l4NFNOKaPYrUxysEMY2pBiynYwfO2LrfayD+VpvYRamyuHG2+uE+je92oPdpcONX/q5EP9zeoGuIRwtjQ=="}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:19.065038 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:19.065686 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:19.081488 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-1b599dcf-0821-428f-87a9-4b0a60e489f8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Getting quotas for project 21924b7f5d004b388f3a663a1a2f47b2. Resources: {'key_pairs'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:04:19.086180 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.quota [None req-1b599dcf-0821-428f-87a9-4b0a60e489f8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Getting quotas for user 9e483ed0926b4f76bc5a30e03436654d and project 21924b7f5d004b388f3a663a1a2f47b2. Resources: {'key_pairs'} {{(pid=120686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:04:19.107844 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-1b599dcf-0821-428f-87a9-4b0a60e489f8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052405 Sep 18 01:04:19.108448 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 468/932] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 18 01:04:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:19.158388 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1250423934", "imageRef": "7a43a509-3d81-4c94-9a83-13aedad51b5c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-610239297", "networks": [{"uuid": "e0ca6a6f-1218-4fb2-9d8f-8889c6e5c139"}]}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:19.167286 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:19.167939 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:19.213933 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.network.neutron [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] validate_networks() for [('e0ca6a6f-1218-4fb2-9d8f-8889c6e5c139', None, None, None, None, None)] {{(pid=120687) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 18 01:04:19.700012 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Flavor limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 18 01:04:19.700448 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Image limits 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 18 01:04:19.700935 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Flavor pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 18 01:04:19.701377 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Image pref 0:0:0 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 18 01:04:19.701802 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.virt.hardware [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 18 01:04:19.710821 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:19.711328 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:19.711770 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:19.712510 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:19.712977 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:19.713407 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:19.730706 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Getting quotas for project 21924b7f5d004b388f3a663a1a2f47b2. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 18 01:04:19.735198 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.quota [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Getting quotas for user 9e483ed0926b4f76bc5a30e03436654d and project 21924b7f5d004b388f3a663a1a2f47b2. Resources: {'ram', 'instances', 'cores'} {{(pid=120687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 18 01:04:19.746801 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Going to run 1 instances... {{(pid=120687) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 18 01:04:19.749044 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a43a509-3d81-4c94-9a83-13aedad51b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 18 01:04:19.793542 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-92eb596a-0485-4a8d-be49-273034404771 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639109 Sep 18 01:04:19.794178 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 465/933] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 18 01:04:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 18 01:04:19.806324 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-554471d7-adcc-41ba-a906-4c78f1883d64 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:19.807068 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-554471d7-adcc-41ba-a906-4c78f1883d64 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:19.866238 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-554471d7-adcc-41ba-a906-4c78f1883d64 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:19.873288 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-554471d7-adcc-41ba-a906-4c78f1883d64 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1258 microversion: 2.1 time: 0.071292 Sep 18 01:04:19.873856 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 469/934] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:19 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:20.895930 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5f16e6e1-f89a-4632-b286-f68008dd85db tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:20.896572 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5f16e6e1-f89a-4632-b286-f68008dd85db tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:20.903352 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f16e6e1-f89a-4632-b286-f68008dd85db tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:20.903845 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f16e6e1-f89a-4632-b286-f68008dd85db tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:20.904920 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f16e6e1-f89a-4632-b286-f68008dd85db tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:20.905643 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f16e6e1-f89a-4632-b286-f68008dd85db tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:20.906110 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f16e6e1-f89a-4632-b286-f68008dd85db tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:20.906553 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5f16e6e1-f89a-4632-b286-f68008dd85db tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:20.969392 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5f16e6e1-f89a-4632-b286-f68008dd85db tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:20.977630 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5f16e6e1-f89a-4632-b286-f68008dd85db tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1310 microversion: 2.1 time: 0.085968 Sep 18 01:04:20.978199 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 466/935] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:20 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:22.001861 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-eb14ff59-b066-4fba-8312-a5b12231d2d0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:22.003227 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-eb14ff59-b066-4fba-8312-a5b12231d2d0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:22.014949 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb14ff59-b066-4fba-8312-a5b12231d2d0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:22.021851 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb14ff59-b066-4fba-8312-a5b12231d2d0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:22.023336 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb14ff59-b066-4fba-8312-a5b12231d2d0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:22.024264 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb14ff59-b066-4fba-8312-a5b12231d2d0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:22.026702 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb14ff59-b066-4fba-8312-a5b12231d2d0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:22.029851 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-eb14ff59-b066-4fba-8312-a5b12231d2d0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:22.221892 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-eb14ff59-b066-4fba-8312-a5b12231d2d0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:22.232862 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-eb14ff59-b066-4fba-8312-a5b12231d2d0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.235260 Sep 18 01:04:22.234020 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 470/936] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:21 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:23.258663 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-b20b667f-d0c8-4f5d-882d-b3c68cdf0b1b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:23.259384 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-b20b667f-d0c8-4f5d-882d-b3c68cdf0b1b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:23.266841 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b20b667f-d0c8-4f5d-882d-b3c68cdf0b1b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.267675 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b20b667f-d0c8-4f5d-882d-b3c68cdf0b1b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.268749 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b20b667f-d0c8-4f5d-882d-b3c68cdf0b1b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.269744 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b20b667f-d0c8-4f5d-882d-b3c68cdf0b1b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:23.270985 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b20b667f-d0c8-4f5d-882d-b3c68cdf0b1b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:23.271660 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-b20b667f-d0c8-4f5d-882d-b3c68cdf0b1b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:23.418163 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-b20b667f-d0c8-4f5d-882d-b3c68cdf0b1b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:23.427835 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-b20b667f-d0c8-4f5d-882d-b3c68cdf0b1b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.174062 Sep 18 01:04:23.428738 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 467/937] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:23 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:24.451153 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8acc3b7d-04ed-40ca-832f-cd523f86d93e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:24.451769 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8acc3b7d-04ed-40ca-832f-cd523f86d93e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:24.457966 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8acc3b7d-04ed-40ca-832f-cd523f86d93e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:24.458433 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8acc3b7d-04ed-40ca-832f-cd523f86d93e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:24.458888 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8acc3b7d-04ed-40ca-832f-cd523f86d93e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:24.459585 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8acc3b7d-04ed-40ca-832f-cd523f86d93e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:24.460043 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8acc3b7d-04ed-40ca-832f-cd523f86d93e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:24.460470 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8acc3b7d-04ed-40ca-832f-cd523f86d93e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:24.609938 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-8acc3b7d-04ed-40ca-832f-cd523f86d93e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:24.617943 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8acc3b7d-04ed-40ca-832f-cd523f86d93e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.170827 Sep 18 01:04:24.618507 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 471/938] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:24 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:25.642203 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-85d5d2bb-2b7f-443b-ab8c-fd70a7cb2cbb tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:25.643472 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-85d5d2bb-2b7f-443b-ab8c-fd70a7cb2cbb tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:25.650410 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85d5d2bb-2b7f-443b-ab8c-fd70a7cb2cbb tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:25.650929 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85d5d2bb-2b7f-443b-ab8c-fd70a7cb2cbb tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:25.651365 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85d5d2bb-2b7f-443b-ab8c-fd70a7cb2cbb tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:25.652135 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85d5d2bb-2b7f-443b-ab8c-fd70a7cb2cbb tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:25.652591 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85d5d2bb-2b7f-443b-ab8c-fd70a7cb2cbb tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:25.653016 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-85d5d2bb-2b7f-443b-ab8c-fd70a7cb2cbb tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:25.798818 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-85d5d2bb-2b7f-443b-ab8c-fd70a7cb2cbb tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:25.811448 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-85d5d2bb-2b7f-443b-ab8c-fd70a7cb2cbb tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.173566 Sep 18 01:04:25.812124 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 468/939] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:25 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:26.833713 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-2e022938-2a06-42cd-9ced-dc4a0e252e08 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:26.834464 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-2e022938-2a06-42cd-9ced-dc4a0e252e08 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:26.842329 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2e022938-2a06-42cd-9ced-dc4a0e252e08 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:26.842971 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2e022938-2a06-42cd-9ced-dc4a0e252e08 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:26.843618 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2e022938-2a06-42cd-9ced-dc4a0e252e08 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:26.844417 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2e022938-2a06-42cd-9ced-dc4a0e252e08 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:26.845090 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2e022938-2a06-42cd-9ced-dc4a0e252e08 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:26.845563 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-2e022938-2a06-42cd-9ced-dc4a0e252e08 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:26.992893 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-2e022938-2a06-42cd-9ced-dc4a0e252e08 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:27.001873 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-2e022938-2a06-42cd-9ced-dc4a0e252e08 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.171985 Sep 18 01:04:27.002452 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 472/940] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:26 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:28.026667 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9130c528-09b6-4ddd-8807-5c4e40d84141 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:28.027303 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9130c528-09b6-4ddd-8807-5c4e40d84141 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:28.034327 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9130c528-09b6-4ddd-8807-5c4e40d84141 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:28.035054 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9130c528-09b6-4ddd-8807-5c4e40d84141 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:28.036011 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9130c528-09b6-4ddd-8807-5c4e40d84141 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:28.036909 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9130c528-09b6-4ddd-8807-5c4e40d84141 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:28.037367 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9130c528-09b6-4ddd-8807-5c4e40d84141 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:28.037792 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9130c528-09b6-4ddd-8807-5c4e40d84141 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:28.174230 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9130c528-09b6-4ddd-8807-5c4e40d84141 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:28.183336 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9130c528-09b6-4ddd-8807-5c4e40d84141 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.160334 Sep 18 01:04:28.184628 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 469/941] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:28 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:29.205831 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ccaf70af-d8f6-4cee-bda3-b6a79a536261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:29.206476 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ccaf70af-d8f6-4cee-bda3-b6a79a536261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:29.213347 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccaf70af-d8f6-4cee-bda3-b6a79a536261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:29.213848 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccaf70af-d8f6-4cee-bda3-b6a79a536261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:29.214318 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccaf70af-d8f6-4cee-bda3-b6a79a536261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.215248 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccaf70af-d8f6-4cee-bda3-b6a79a536261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:29.215720 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccaf70af-d8f6-4cee-bda3-b6a79a536261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:29.216147 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccaf70af-d8f6-4cee-bda3-b6a79a536261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:29.361952 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ccaf70af-d8f6-4cee-bda3-b6a79a536261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:29.373397 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ccaf70af-d8f6-4cee-bda3-b6a79a536261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.171528 Sep 18 01:04:29.374093 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 473/942] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:29 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:30.397058 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-feaae452-698b-43dc-adfe-3147f5a37add tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:30.397790 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-feaae452-698b-43dc-adfe-3147f5a37add tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:30.400190 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:30.401116 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=6 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:30.406688 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feaae452-698b-43dc-adfe-3147f5a37add tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.407212 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feaae452-698b-43dc-adfe-3147f5a37add tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.407680 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feaae452-698b-43dc-adfe-3147f5a37add tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.408397 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feaae452-698b-43dc-adfe-3147f5a37add tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.408833 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feaae452-698b-43dc-adfe-3147f5a37add tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.409266 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-feaae452-698b-43dc-adfe-3147f5a37add tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.543868 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-feaae452-698b-43dc-adfe-3147f5a37add tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:30.552308 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-feaae452-698b-43dc-adfe-3147f5a37add tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.159220 Sep 18 01:04:30.552882 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 470/943] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:30 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:30.752983 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-d07e6cbb-c0fe-445d-84f3-509aabcd2c9d req-e4e5c8dd-3abb-4492-bf47-04f8d286410e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5e6940-fbfc-45f5-9e14-08347d250167", "tag": "49102bd9-16f0-43a0-90f2-24b18239858c"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:30.761401 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell0:SELECT=6 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:30.767030 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-d07e6cbb-c0fe-445d-84f3-509aabcd2c9d req-e4e5c8dd-3abb-4492-bf47-04f8d286410e service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:30.767854 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-d07e6cbb-c0fe-445d-84f3-509aabcd2c9d req-e4e5c8dd-3abb-4492-bf47-04f8d286410e service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:30.768657 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-d07e6cbb-c0fe-445d-84f3-509aabcd2c9d req-e4e5c8dd-3abb-4492-bf47-04f8d286410e service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:30.781964 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-d07e6cbb-c0fe-445d-84f3-509aabcd2c9d req-e4e5c8dd-3abb-4492-bf47-04f8d286410e service nova] Creating event network-changed:49102bd9-16f0-43a0-90f2-24b18239858c for instance 9f5e6940-fbfc-45f5-9e14-08347d250167 on hv-cinder-maste Sep 18 01:04:30.787391 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-d07e6cbb-c0fe-445d-84f3-509aabcd2c9d req-e4e5c8dd-3abb-4492-bf47-04f8d286410e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038300 Sep 18 01:04:30.788103 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 474/944] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:31.575460 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-adfae529-cb41-46c1-b09a-259c50390ee5 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:31.576074 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-adfae529-cb41-46c1-b09a-259c50390ee5 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:31.583152 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-adfae529-cb41-46c1-b09a-259c50390ee5 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:31.583637 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-adfae529-cb41-46c1-b09a-259c50390ee5 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:31.584072 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-adfae529-cb41-46c1-b09a-259c50390ee5 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:31.584763 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-adfae529-cb41-46c1-b09a-259c50390ee5 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:31.585222 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-adfae529-cb41-46c1-b09a-259c50390ee5 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:31.585647 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-adfae529-cb41-46c1-b09a-259c50390ee5 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:31.715004 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-adfae529-cb41-46c1-b09a-259c50390ee5 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:31.723375 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-adfae529-cb41-46c1-b09a-259c50390ee5 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.151762 Sep 18 01:04:31.724301 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 471/945] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:31 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:32.746988 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-56625e55-1bb4-44e2-b8a0-4e91e716810b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:32.747610 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-56625e55-1bb4-44e2-b8a0-4e91e716810b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:32.754830 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-56625e55-1bb4-44e2-b8a0-4e91e716810b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.755319 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-56625e55-1bb4-44e2-b8a0-4e91e716810b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.755757 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-56625e55-1bb4-44e2-b8a0-4e91e716810b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.756456 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-56625e55-1bb4-44e2-b8a0-4e91e716810b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:32.756915 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-56625e55-1bb4-44e2-b8a0-4e91e716810b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:32.757342 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-56625e55-1bb4-44e2-b8a0-4e91e716810b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:32.885843 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-56625e55-1bb4-44e2-b8a0-4e91e716810b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:32.893531 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-56625e55-1bb4-44e2-b8a0-4e91e716810b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.151301 Sep 18 01:04:32.894117 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 475/946] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:32 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:33.916684 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a0ecd474-d843-49ef-be1e-45b7dde3a9a6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:33.917291 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a0ecd474-d843-49ef-be1e-45b7dde3a9a6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:33.923645 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a0ecd474-d843-49ef-be1e-45b7dde3a9a6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:33.924132 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a0ecd474-d843-49ef-be1e-45b7dde3a9a6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:33.924570 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a0ecd474-d843-49ef-be1e-45b7dde3a9a6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:33.925857 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a0ecd474-d843-49ef-be1e-45b7dde3a9a6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:33.926500 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a0ecd474-d843-49ef-be1e-45b7dde3a9a6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:33.927033 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a0ecd474-d843-49ef-be1e-45b7dde3a9a6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:34.053733 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a0ecd474-d843-49ef-be1e-45b7dde3a9a6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:34.061580 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a0ecd474-d843-49ef-be1e-45b7dde3a9a6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.148776 Sep 18 01:04:34.062153 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 472/947] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:33 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:35.073520 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-7107e00f-7576-4ee8-a266-04f95a3b0765 req-704e0c46-ac68-428e-bccf-18e9c62cfcca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5e6940-fbfc-45f5-9e14-08347d250167", "name": "network-vif-plugged", "status": "completed", "tag": "49102bd9-16f0-43a0-90f2-24b18239858c"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:35.085014 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-7107e00f-7576-4ee8-a266-04f95a3b0765 req-704e0c46-ac68-428e-bccf-18e9c62cfcca service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:35.085680 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-7107e00f-7576-4ee8-a266-04f95a3b0765 req-704e0c46-ac68-428e-bccf-18e9c62cfcca service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:35.086180 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-7107e00f-7576-4ee8-a266-04f95a3b0765 req-704e0c46-ac68-428e-bccf-18e9c62cfcca service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:35.086546 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-78705130-7ad4-4176-8af4-cdff93e95ae7 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:35.087203 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-78705130-7ad4-4176-8af4-cdff93e95ae7 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:35.094080 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-78705130-7ad4-4176-8af4-cdff93e95ae7 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:35.094577 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-78705130-7ad4-4176-8af4-cdff93e95ae7 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:35.095039 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-78705130-7ad4-4176-8af4-cdff93e95ae7 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:35.095893 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-78705130-7ad4-4176-8af4-cdff93e95ae7 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:35.096353 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-78705130-7ad4-4176-8af4-cdff93e95ae7 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:35.096778 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-78705130-7ad4-4176-8af4-cdff93e95ae7 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:35.098731 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-7107e00f-7576-4ee8-a266-04f95a3b0765 req-704e0c46-ac68-428e-bccf-18e9c62cfcca service nova] Creating event network-vif-plugged:49102bd9-16f0-43a0-90f2-24b18239858c for instance 9f5e6940-fbfc-45f5-9e14-08347d250167 on hv-cinder-maste Sep 18 01:04:35.105108 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-7107e00f-7576-4ee8-a266-04f95a3b0765 req-704e0c46-ac68-428e-bccf-18e9c62cfcca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033840 Sep 18 01:04:35.105108 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 476/948] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:35.234047 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-78705130-7ad4-4176-8af4-cdff93e95ae7 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:35.242153 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-78705130-7ad4-4176-8af4-cdff93e95ae7 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.161579 Sep 18 01:04:35.242734 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 473/949] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:35 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:04:36.266033 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c70b0907-c863-4e8f-98a4-c0877a5fabdf tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:36.266651 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c70b0907-c863-4e8f-98a4-c0877a5fabdf tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:36.273554 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c70b0907-c863-4e8f-98a4-c0877a5fabdf tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:36.274042 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c70b0907-c863-4e8f-98a4-c0877a5fabdf tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:36.274478 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c70b0907-c863-4e8f-98a4-c0877a5fabdf tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:36.275202 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c70b0907-c863-4e8f-98a4-c0877a5fabdf tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:36.275659 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c70b0907-c863-4e8f-98a4-c0877a5fabdf tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:36.276088 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c70b0907-c863-4e8f-98a4-c0877a5fabdf tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:36.407001 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c70b0907-c863-4e8f-98a4-c0877a5fabdf tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:36.415056 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c70b0907-c863-4e8f-98a4-c0877a5fabdf tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1358 microversion: 2.1 time: 0.153786 Sep 18 01:04:36.415630 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 477/950] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:36 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:37.437812 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-7ffaf9dc-3584-4e5b-aaaf-8f8b174212e6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:37.438453 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-7ffaf9dc-3584-4e5b-aaaf-8f8b174212e6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:37.445476 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7ffaf9dc-3584-4e5b-aaaf-8f8b174212e6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.445962 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7ffaf9dc-3584-4e5b-aaaf-8f8b174212e6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.446401 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7ffaf9dc-3584-4e5b-aaaf-8f8b174212e6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:37.447127 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7ffaf9dc-3584-4e5b-aaaf-8f8b174212e6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.447589 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7ffaf9dc-3584-4e5b-aaaf-8f8b174212e6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.448016 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-7ffaf9dc-3584-4e5b-aaaf-8f8b174212e6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:37.576736 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-7ffaf9dc-3584-4e5b-aaaf-8f8b174212e6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:37.585131 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-7ffaf9dc-3584-4e5b-aaaf-8f8b174212e6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1547 microversion: 2.1 time: 0.151193 Sep 18 01:04:37.585729 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 474/951] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:37 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:37.607732 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ea51925e-b619-4e13-a41d-6996dc719834 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:37.608369 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ea51925e-b619-4e13-a41d-6996dc719834 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:37.615511 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ea51925e-b619-4e13-a41d-6996dc719834 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.615998 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ea51925e-b619-4e13-a41d-6996dc719834 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.616435 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ea51925e-b619-4e13-a41d-6996dc719834 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:37.617130 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ea51925e-b619-4e13-a41d-6996dc719834 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.617590 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ea51925e-b619-4e13-a41d-6996dc719834 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.618018 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ea51925e-b619-4e13-a41d-6996dc719834 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:37.746859 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ea51925e-b619-4e13-a41d-6996dc719834 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:37.754831 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ea51925e-b619-4e13-a41d-6996dc719834 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1547 microversion: 2.1 time: 0.151188 Sep 18 01:04:37.755638 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 478/952] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:37 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:37.777433 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1106f970-522f-4fa0-8b35-a6009953b241 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:37.782284 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1106f970-522f-4fa0-8b35-a6009953b241 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:37.783085 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1106f970-522f-4fa0-8b35-a6009953b241 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Searching by: {'deleted': False, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2'} {{(pid=120687) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 18 01:04:37.790222 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1106f970-522f-4fa0-8b35-a6009953b241 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.790698 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1106f970-522f-4fa0-8b35-a6009953b241 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.791171 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1106f970-522f-4fa0-8b35-a6009953b241 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:37.791887 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1106f970-522f-4fa0-8b35-a6009953b241 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.792340 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1106f970-522f-4fa0-8b35-a6009953b241 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.792759 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1106f970-522f-4fa0-8b35-a6009953b241 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:37.876467 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.multi_cell_list [None req-1106f970-522f-4fa0-8b35-a6009953b241 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120687) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 18 01:04:37.969916 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1106f970-522f-4fa0-8b35-a6009953b241 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.196265 Sep 18 01:04:37.970502 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 475/953] 10.222.0.33 () {58 vars in 1125 bytes} [Sun Sep 18 01:04:37 2022] GET /compute/v2.1/servers => generated 343 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:37.982528 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-539fc32d-1e89-4a95-83a8-3ad638d2b5d2 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:37.983171 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-539fc32d-1e89-4a95-83a8-3ad638d2b5d2 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:37.989876 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539fc32d-1e89-4a95-83a8-3ad638d2b5d2 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.990357 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539fc32d-1e89-4a95-83a8-3ad638d2b5d2 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.990798 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539fc32d-1e89-4a95-83a8-3ad638d2b5d2 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:37.991529 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539fc32d-1e89-4a95-83a8-3ad638d2b5d2 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:37.991988 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539fc32d-1e89-4a95-83a8-3ad638d2b5d2 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:37.992407 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-539fc32d-1e89-4a95-83a8-3ad638d2b5d2 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:38.128963 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-539fc32d-1e89-4a95-83a8-3ad638d2b5d2 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:38.136548 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-539fc32d-1e89-4a95-83a8-3ad638d2b5d2 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1547 microversion: 2.1 time: 0.158123 Sep 18 01:04:38.137111 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 479/954] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:37 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:39.677791 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1bf4652c-0d32-4255-ab01-da94e761d763 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5821a72-73b3-493a-97ed-82e1f8c05f2c"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:39.680246 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1bf4652c-0d32-4255-ab01-da94e761d763 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:39.686895 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1bf4652c-0d32-4255-ab01-da94e761d763 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.687382 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1bf4652c-0d32-4255-ab01-da94e761d763 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.687822 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1bf4652c-0d32-4255-ab01-da94e761d763 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.688514 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1bf4652c-0d32-4255-ab01-da94e761d763 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:39.688974 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1bf4652c-0d32-4255-ab01-da94e761d763 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:39.689400 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1bf4652c-0d32-4255-ab01-da94e761d763 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:39.950994 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1bf4652c-0d32-4255-ab01-da94e761d763 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "POST /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277611 Sep 18 01:04:39.951606 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 476/955] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 18 01:04:39 2022] POST /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:42.261643 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-17e6293e-eea7-4949-a2b9-ca2b0c7d3813 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:42.262260 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-17e6293e-eea7-4949-a2b9-ca2b0c7d3813 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:42.269164 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-17e6293e-eea7-4949-a2b9-ca2b0c7d3813 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:42.269657 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-17e6293e-eea7-4949-a2b9-ca2b0c7d3813 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:42.270098 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-17e6293e-eea7-4949-a2b9-ca2b0c7d3813 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:42.270813 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-17e6293e-eea7-4949-a2b9-ca2b0c7d3813 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:42.271279 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-17e6293e-eea7-4949-a2b9-ca2b0c7d3813 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:42.271707 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-17e6293e-eea7-4949-a2b9-ca2b0c7d3813 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:42.399567 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-17e6293e-eea7-4949-a2b9-ca2b0c7d3813 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:42.407603 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-17e6293e-eea7-4949-a2b9-ca2b0c7d3813 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1593 microversion: 2.1 time: 0.149833 Sep 18 01:04:42.408166 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 480/956] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:42 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:04:44.264099 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-46a28106-4c8d-44e0-99e8-563204034500 req-45f10250-105b-4b4a-9872-03fb1cecfb21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5e6940-fbfc-45f5-9e14-08347d250167", "tag": "49102bd9-16f0-43a0-90f2-24b18239858c"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:44.275998 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-46a28106-4c8d-44e0-99e8-563204034500 req-45f10250-105b-4b4a-9872-03fb1cecfb21 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:44.275998 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-46a28106-4c8d-44e0-99e8-563204034500 req-45f10250-105b-4b4a-9872-03fb1cecfb21 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:44.276322 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-46a28106-4c8d-44e0-99e8-563204034500 req-45f10250-105b-4b4a-9872-03fb1cecfb21 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:44.288235 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-46a28106-4c8d-44e0-99e8-563204034500 req-45f10250-105b-4b4a-9872-03fb1cecfb21 service nova] Creating event network-changed:49102bd9-16f0-43a0-90f2-24b18239858c for instance 9f5e6940-fbfc-45f5-9e14-08347d250167 on hv-cinder-maste Sep 18 01:04:44.293340 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-46a28106-4c8d-44e0-99e8-563204034500 req-45f10250-105b-4b4a-9872-03fb1cecfb21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034263 Sep 18 01:04:44.294302 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 477/957] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:45.263520 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-8f1558b6-35d1-424d-93a1-8d59f15b6a03 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-341349344"}} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:45.264045 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-8f1558b6-35d1-424d-93a1-8d59f15b6a03 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:45.271495 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1558b6-35d1-424d-93a1-8d59f15b6a03 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:45.271977 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1558b6-35d1-424d-93a1-8d59f15b6a03 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:45.272412 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1558b6-35d1-424d-93a1-8d59f15b6a03 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:45.273109 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1558b6-35d1-424d-93a1-8d59f15b6a03 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:45.273561 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1558b6-35d1-424d-93a1-8d59f15b6a03 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:45.273977 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-8f1558b6-35d1-424d-93a1-8d59f15b6a03 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:45.406858 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.network.security_group_api [None req-8f1558b6-35d1-424d-93a1-8d59f15b6a03 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Adding security group 608ddda2-8d9c-4f8f-ae2d-2cf7b7e1b3bc to port 49102bd9-16f0-43a0-90f2-24b18239858c Sep 18 01:04:45.750866 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-8f1558b6-35d1-424d-93a1-8d59f15b6a03 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "POST /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/action" status: 202 len: 0 microversion: 2.1 time: 0.491314 Sep 18 01:04:45.751474 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 481/958] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 01:04:45 2022] POST /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:04:45.760737 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-a45650f8-458a-4d36-9995-83945bf05261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:04:45.761882 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-a45650f8-458a-4d36-9995-83945bf05261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:04:45.762713 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-abbf2f4b-194f-4664-8422-128587b45ee5 req-110c22f0-5df7-409c-88c2-47b9eb2ba909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5e6940-fbfc-45f5-9e14-08347d250167", "tag": "49102bd9-16f0-43a0-90f2-24b18239858c"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:04:45.769672 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a45650f8-458a-4d36-9995-83945bf05261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:45.770185 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a45650f8-458a-4d36-9995-83945bf05261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:45.770660 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a45650f8-458a-4d36-9995-83945bf05261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:45.771411 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a45650f8-458a-4d36-9995-83945bf05261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:45.771861 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a45650f8-458a-4d36-9995-83945bf05261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:45.772306 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-a45650f8-458a-4d36-9995-83945bf05261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:45.780434 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-abbf2f4b-194f-4664-8422-128587b45ee5 req-110c22f0-5df7-409c-88c2-47b9eb2ba909 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:04:45.781336 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-abbf2f4b-194f-4664-8422-128587b45ee5 req-110c22f0-5df7-409c-88c2-47b9eb2ba909 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:04:45.783616 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-abbf2f4b-194f-4664-8422-128587b45ee5 req-110c22f0-5df7-409c-88c2-47b9eb2ba909 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:04:45.800196 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-abbf2f4b-194f-4664-8422-128587b45ee5 req-110c22f0-5df7-409c-88c2-47b9eb2ba909 service nova] Creating event network-changed:49102bd9-16f0-43a0-90f2-24b18239858c for instance 9f5e6940-fbfc-45f5-9e14-08347d250167 on hv-cinder-maste Sep 18 01:04:45.805776 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-abbf2f4b-194f-4664-8422-128587b45ee5 req-110c22f0-5df7-409c-88c2-47b9eb2ba909 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047529 Sep 18 01:04:45.807064 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 478/959] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:04:45.942207 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-a45650f8-458a-4d36-9995-83945bf05261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:04:45.950440 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-a45650f8-458a-4d36-9995-83945bf05261 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1757 microversion: 2.1 time: 0.193825 Sep 18 01:04:45.951037 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 482/960] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:04:45 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 18 01:05:11.449896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell0:SELECT=2 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:11.450842 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:11.451647 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:11.456613 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-667f78a3-e17e-4bc7-b089-a78c2736cdbc tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:11.458937 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-667f78a3-e17e-4bc7-b089-a78c2736cdbc tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:11.467374 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-667f78a3-e17e-4bc7-b089-a78c2736cdbc tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:11.467866 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-667f78a3-e17e-4bc7-b089-a78c2736cdbc tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:11.468310 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-667f78a3-e17e-4bc7-b089-a78c2736cdbc tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:11.469011 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-667f78a3-e17e-4bc7-b089-a78c2736cdbc tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:11.469475 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-667f78a3-e17e-4bc7-b089-a78c2736cdbc tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:11.470632 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-667f78a3-e17e-4bc7-b089-a78c2736cdbc tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:11.546457 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-667f78a3-e17e-4bc7-b089-a78c2736cdbc tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "POST /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/action" status: 202 len: 0 microversion: 2.1 time: 0.097680 Sep 18 01:05:11.547216 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 479/961] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 01:05:11 2022] POST /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:11.556154 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ccb87e09-b693-4627-ba4c-e69887333020 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:11.556726 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ccb87e09-b693-4627-ba4c-e69887333020 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:11.559170 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:11.559839 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=68 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:11.567047 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccb87e09-b693-4627-ba4c-e69887333020 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:11.567638 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccb87e09-b693-4627-ba4c-e69887333020 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:11.568037 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccb87e09-b693-4627-ba4c-e69887333020 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:11.568866 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccb87e09-b693-4627-ba4c-e69887333020 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:11.569357 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccb87e09-b693-4627-ba4c-e69887333020 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:11.569920 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ccb87e09-b693-4627-ba4c-e69887333020 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:11.716574 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-ccb87e09-b693-4627-ba4c-e69887333020 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:11.726551 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ccb87e09-b693-4627-ba4c-e69887333020 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1749 microversion: 2.1 time: 0.174467 Sep 18 01:05:11.727254 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 483/962] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:11 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:12.752184 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-25f82bf2-f436-41dd-a7a2-855c4b261094 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:12.752886 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-25f82bf2-f436-41dd-a7a2-855c4b261094 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:12.759063 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25f82bf2-f436-41dd-a7a2-855c4b261094 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:12.759554 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25f82bf2-f436-41dd-a7a2-855c4b261094 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:12.759992 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25f82bf2-f436-41dd-a7a2-855c4b261094 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:12.760686 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25f82bf2-f436-41dd-a7a2-855c4b261094 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:12.761148 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25f82bf2-f436-41dd-a7a2-855c4b261094 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:12.761575 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-25f82bf2-f436-41dd-a7a2-855c4b261094 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:12.901556 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-25f82bf2-f436-41dd-a7a2-855c4b261094 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:12.910287 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-25f82bf2-f436-41dd-a7a2-855c4b261094 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1754 microversion: 2.1 time: 0.163439 Sep 18 01:05:12.910863 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 480/963] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:12 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:13.934741 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-125e5760-2686-44d2-bfa9-fd22985c7511 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:13.935356 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-125e5760-2686-44d2-bfa9-fd22985c7511 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:13.942449 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-125e5760-2686-44d2-bfa9-fd22985c7511 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:13.942969 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-125e5760-2686-44d2-bfa9-fd22985c7511 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:13.943406 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-125e5760-2686-44d2-bfa9-fd22985c7511 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:13.944094 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-125e5760-2686-44d2-bfa9-fd22985c7511 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:13.944553 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-125e5760-2686-44d2-bfa9-fd22985c7511 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:13.944975 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-125e5760-2686-44d2-bfa9-fd22985c7511 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:14.090976 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-125e5760-2686-44d2-bfa9-fd22985c7511 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:14.099510 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-125e5760-2686-44d2-bfa9-fd22985c7511 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1754 microversion: 2.1 time: 0.168728 Sep 18 01:05:14.100076 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 484/964] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:13 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:15.123295 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-a6c6fd6a-441d-4235-94f9-bea4d55bd59e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:15.123911 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-a6c6fd6a-441d-4235-94f9-bea4d55bd59e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:15.131114 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a6c6fd6a-441d-4235-94f9-bea4d55bd59e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:15.131599 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a6c6fd6a-441d-4235-94f9-bea4d55bd59e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:15.132036 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a6c6fd6a-441d-4235-94f9-bea4d55bd59e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:15.132722 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a6c6fd6a-441d-4235-94f9-bea4d55bd59e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:15.133178 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a6c6fd6a-441d-4235-94f9-bea4d55bd59e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:15.133603 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-a6c6fd6a-441d-4235-94f9-bea4d55bd59e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:15.273356 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-a6c6fd6a-441d-4235-94f9-bea4d55bd59e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:15.281441 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-a6c6fd6a-441d-4235-94f9-bea4d55bd59e tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1754 microversion: 2.1 time: 0.162005 Sep 18 01:05:15.282104 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 481/965] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:15 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:16.304632 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-3a87667f-da32-41ce-975d-b565d9608b4f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:16.305184 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-3a87667f-da32-41ce-975d-b565d9608b4f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:16.311834 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3a87667f-da32-41ce-975d-b565d9608b4f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:16.312334 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3a87667f-da32-41ce-975d-b565d9608b4f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:16.312775 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3a87667f-da32-41ce-975d-b565d9608b4f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:16.313476 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3a87667f-da32-41ce-975d-b565d9608b4f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:16.314056 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3a87667f-da32-41ce-975d-b565d9608b4f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:16.314487 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-3a87667f-da32-41ce-975d-b565d9608b4f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:16.458050 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-3a87667f-da32-41ce-975d-b565d9608b4f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:16.466280 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-3a87667f-da32-41ce-975d-b565d9608b4f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1754 microversion: 2.1 time: 0.165631 Sep 18 01:05:16.466867 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 485/966] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:16 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:17.489564 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9776a574-00ae-414b-ba36-a481c7d078f0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:17.490242 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9776a574-00ae-414b-ba36-a481c7d078f0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:17.496434 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9776a574-00ae-414b-ba36-a481c7d078f0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:17.496925 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9776a574-00ae-414b-ba36-a481c7d078f0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:17.497519 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9776a574-00ae-414b-ba36-a481c7d078f0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:17.498223 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9776a574-00ae-414b-ba36-a481c7d078f0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:17.498688 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9776a574-00ae-414b-ba36-a481c7d078f0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:17.499142 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9776a574-00ae-414b-ba36-a481c7d078f0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:17.636481 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-9776a574-00ae-414b-ba36-a481c7d078f0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:17.645314 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9776a574-00ae-414b-ba36-a481c7d078f0 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1754 microversion: 2.1 time: 0.159687 Sep 18 01:05:17.645888 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 482/967] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:17 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:18.667661 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-b427e202-3ef0-46dc-8bb7-c89940a713c6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:18.668296 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-b427e202-3ef0-46dc-8bb7-c89940a713c6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:18.674769 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b427e202-3ef0-46dc-8bb7-c89940a713c6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:18.675277 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b427e202-3ef0-46dc-8bb7-c89940a713c6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:18.675714 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b427e202-3ef0-46dc-8bb7-c89940a713c6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:18.676436 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b427e202-3ef0-46dc-8bb7-c89940a713c6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:18.676921 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b427e202-3ef0-46dc-8bb7-c89940a713c6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:18.677345 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-b427e202-3ef0-46dc-8bb7-c89940a713c6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:18.820889 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-b427e202-3ef0-46dc-8bb7-c89940a713c6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:18.831237 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-b427e202-3ef0-46dc-8bb7-c89940a713c6 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1754 microversion: 2.1 time: 0.167410 Sep 18 01:05:18.831796 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 486/968] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:18 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:19.853962 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-5c760993-e74d-4fa4-85a5-9c06a45b2900 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:19.854568 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-5c760993-e74d-4fa4-85a5-9c06a45b2900 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:19.861954 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5c760993-e74d-4fa4-85a5-9c06a45b2900 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:19.862439 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5c760993-e74d-4fa4-85a5-9c06a45b2900 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:19.862900 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5c760993-e74d-4fa4-85a5-9c06a45b2900 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:19.863593 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5c760993-e74d-4fa4-85a5-9c06a45b2900 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:19.864053 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5c760993-e74d-4fa4-85a5-9c06a45b2900 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:19.864481 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-5c760993-e74d-4fa4-85a5-9c06a45b2900 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:20.007609 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-5c760993-e74d-4fa4-85a5-9c06a45b2900 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:20.015747 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-5c760993-e74d-4fa4-85a5-9c06a45b2900 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1754 microversion: 2.1 time: 0.165626 Sep 18 01:05:20.016307 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 483/969] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:19 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:21.039605 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-c697b0f6-0610-406f-9b61-96955607e94f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:21.040229 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-c697b0f6-0610-406f-9b61-96955607e94f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:21.046939 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c697b0f6-0610-406f-9b61-96955607e94f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:21.047428 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c697b0f6-0610-406f-9b61-96955607e94f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:21.047865 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c697b0f6-0610-406f-9b61-96955607e94f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:21.049187 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c697b0f6-0610-406f-9b61-96955607e94f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:21.049650 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c697b0f6-0610-406f-9b61-96955607e94f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:21.050079 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-c697b0f6-0610-406f-9b61-96955607e94f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:21.190684 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-c697b0f6-0610-406f-9b61-96955607e94f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:21.198933 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-c697b0f6-0610-406f-9b61-96955607e94f tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1754 microversion: 2.1 time: 0.163212 Sep 18 01:05:21.199507 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 487/970] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:21 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:22.221952 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-1fa8598a-bcc3-400a-b4c5-16ef51e66c2d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:22.222517 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-1fa8598a-bcc3-400a-b4c5-16ef51e66c2d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:22.229220 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1fa8598a-bcc3-400a-b4c5-16ef51e66c2d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:22.229707 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1fa8598a-bcc3-400a-b4c5-16ef51e66c2d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:22.230165 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1fa8598a-bcc3-400a-b4c5-16ef51e66c2d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:22.231141 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1fa8598a-bcc3-400a-b4c5-16ef51e66c2d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:22.231599 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1fa8598a-bcc3-400a-b4c5-16ef51e66c2d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:22.232024 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-1fa8598a-bcc3-400a-b4c5-16ef51e66c2d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:22.375452 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-1fa8598a-bcc3-400a-b4c5-16ef51e66c2d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:22.384246 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-1fa8598a-bcc3-400a-b4c5-16ef51e66c2d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1754 microversion: 2.1 time: 0.166341 Sep 18 01:05:22.384823 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 484/971] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:22 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:23.406808 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-0f632d4e-88a3-4ed3-ac3b-87d16c013e22 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:23.407450 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-0f632d4e-88a3-4ed3-ac3b-87d16c013e22 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:23.413570 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f632d4e-88a3-4ed3-ac3b-87d16c013e22 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:23.414097 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f632d4e-88a3-4ed3-ac3b-87d16c013e22 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:23.414533 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f632d4e-88a3-4ed3-ac3b-87d16c013e22 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:23.415250 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f632d4e-88a3-4ed3-ac3b-87d16c013e22 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:23.415706 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f632d4e-88a3-4ed3-ac3b-87d16c013e22 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:23.416127 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-0f632d4e-88a3-4ed3-ac3b-87d16c013e22 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:23.558193 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-0f632d4e-88a3-4ed3-ac3b-87d16c013e22 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:05:23.567194 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-0f632d4e-88a3-4ed3-ac3b-87d16c013e22 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1757 microversion: 2.1 time: 0.164433 Sep 18 01:05:23.567763 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 488/972] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:05:23 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:05:56.144039 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-9fab9655-8894-441c-b79d-73a23c43acda tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-341349344"}} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:56.144661 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-9fab9655-8894-441c-b79d-73a23c43acda tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:56.146696 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_api:SELECT=12 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:56.147529 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG dbcounter [-] [120687] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:56.153074 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9fab9655-8894-441c-b79d-73a23c43acda tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:56.153566 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9fab9655-8894-441c-b79d-73a23c43acda tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:56.154000 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9fab9655-8894-441c-b79d-73a23c43acda tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:56.154695 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9fab9655-8894-441c-b79d-73a23c43acda tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:56.155187 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9fab9655-8894-441c-b79d-73a23c43acda tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:56.155615 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-9fab9655-8894-441c-b79d-73a23c43acda tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:56.284105 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.network.security_group_api [None req-9fab9655-8894-441c-b79d-73a23c43acda tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Removing security group 608ddda2-8d9c-4f8f-ae2d-2cf7b7e1b3bc from port 49102bd9-16f0-43a0-90f2-24b18239858c Sep 18 01:05:56.817409 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-9fab9655-8894-441c-b79d-73a23c43acda tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "POST /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/action" status: 202 len: 0 microversion: 2.1 time: 0.677336 Sep 18 01:05:56.818016 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 485/973] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 18 01:05:56 2022] POST /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:56.827109 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-216d4744-7c37-4d95-b3d1-3cdffcbae583 req-af4a4934-89da-4e41-864e-e32fe086f16a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5e6940-fbfc-45f5-9e14-08347d250167", "tag": "49102bd9-16f0-43a0-90f2-24b18239858c"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:56.833395 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_api:SELECT=12 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:56.834301 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG dbcounter [-] [120686] Writing DB stats nova_cell1:SELECT=36 {{(pid=120686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:56.840583 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-216d4744-7c37-4d95-b3d1-3cdffcbae583 req-af4a4934-89da-4e41-864e-e32fe086f16a service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:56.847520 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-216d4744-7c37-4d95-b3d1-3cdffcbae583 req-af4a4934-89da-4e41-864e-e32fe086f16a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:56.858430 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-216d4744-7c37-4d95-b3d1-3cdffcbae583 req-af4a4934-89da-4e41-864e-e32fe086f16a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:56.879159 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-216d4744-7c37-4d95-b3d1-3cdffcbae583 req-af4a4934-89da-4e41-864e-e32fe086f16a service nova] Creating event network-changed:49102bd9-16f0-43a0-90f2-24b18239858c for instance 9f5e6940-fbfc-45f5-9e14-08347d250167 on hv-cinder-maste Sep 18 01:05:56.884450 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-216d4744-7c37-4d95-b3d1-3cdffcbae583 req-af4a4934-89da-4e41-864e-e32fe086f16a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061393 Sep 18 01:05:56.885835 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 489/974] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:05:57.884139 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-049e3c57-c851-4eaf-9918-738f3eb480e1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:57.884722 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-049e3c57-c851-4eaf-9918-738f3eb480e1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:57.890680 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-049e3c57-c851-4eaf-9918-738f3eb480e1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:57.891204 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-049e3c57-c851-4eaf-9918-738f3eb480e1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:57.891641 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-049e3c57-c851-4eaf-9918-738f3eb480e1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:57.892331 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-049e3c57-c851-4eaf-9918-738f3eb480e1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:57.892787 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-049e3c57-c851-4eaf-9918-738f3eb480e1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:57.893208 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-049e3c57-c851-4eaf-9918-738f3eb480e1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:57.976977 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.objects.instance [None req-049e3c57-c851-4eaf-9918-738f3eb480e1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lazy-loading 'services' on Instance uuid 9f5e6940-fbfc-45f5-9e14-08347d250167 {{(pid=120687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 18 01:05:58.052551 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-049e3c57-c851-4eaf-9918-738f3eb480e1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/os-volume_attachments/f5821a72-73b3-493a-97ed-82e1f8c05f2c" status: 202 len: 0 microversion: 2.1 time: 0.172608 Sep 18 01:05:58.053927 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 486/975] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 01:05:57 2022] DELETE /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/os-volume_attachments/f5821a72-73b3-493a-97ed-82e1f8c05f2c => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 18 01:05:58.063724 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-f4bea7c0-63e9-45fc-b846-cf03528e8cad tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:58.066615 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-f4bea7c0-63e9-45fc-b846-cf03528e8cad tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:58.073551 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4bea7c0-63e9-45fc-b846-cf03528e8cad tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:58.074224 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4bea7c0-63e9-45fc-b846-cf03528e8cad tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:58.074675 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4bea7c0-63e9-45fc-b846-cf03528e8cad tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:58.075456 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4bea7c0-63e9-45fc-b846-cf03528e8cad tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:58.075974 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4bea7c0-63e9-45fc-b846-cf03528e8cad tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:58.076453 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-f4bea7c0-63e9-45fc-b846-cf03528e8cad tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:58.106873 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-f4bea7c0-63e9-45fc-b846-cf03528e8cad tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048826 Sep 18 01:05:58.108409 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 490/976] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:05:58 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:05:58.900254 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [req-d533759d-9559-4e36-afec-f77a6313f25d req-533643fe-7b59-46aa-84ea-9a6653109fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5e6940-fbfc-45f5-9e14-08347d250167", "tag": "49102bd9-16f0-43a0-90f2-24b18239858c"}]} {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:05:58.910551 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-d533759d-9559-4e36-afec-f77a6313f25d req-533643fe-7b59-46aa-84ea-9a6653109fc4 service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:58.910917 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-d533759d-9559-4e36-afec-f77a6313f25d req-533643fe-7b59-46aa-84ea-9a6653109fc4 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:58.911346 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [req-d533759d-9559-4e36-afec-f77a6313f25d req-533643fe-7b59-46aa-84ea-9a6653109fc4 service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:58.923194 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.compute.server_external_events [req-d533759d-9559-4e36-afec-f77a6313f25d req-533643fe-7b59-46aa-84ea-9a6653109fc4 service nova] Creating event network-changed:49102bd9-16f0-43a0-90f2-24b18239858c for instance 9f5e6940-fbfc-45f5-9e14-08347d250167 on hv-cinder-maste Sep 18 01:05:58.928192 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [req-d533759d-9559-4e36-afec-f77a6313f25d req-533643fe-7b59-46aa-84ea-9a6653109fc4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032410 Sep 18 01:05:58.929542 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 487/977] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 18 01:05:59.121665 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-ab95b681-b4a3-4891-a845-47161c9d18b9 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:59.124680 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-ab95b681-b4a3-4891-a845-47161c9d18b9 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:59.131086 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ab95b681-b4a3-4891-a845-47161c9d18b9 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.131652 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ab95b681-b4a3-4891-a845-47161c9d18b9 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.132197 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ab95b681-b4a3-4891-a845-47161c9d18b9 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.132959 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ab95b681-b4a3-4891-a845-47161c9d18b9 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.133476 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ab95b681-b4a3-4891-a845-47161c9d18b9 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.133969 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-ab95b681-b4a3-4891-a845-47161c9d18b9 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.165373 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-ab95b681-b4a3-4891-a845-47161c9d18b9 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047612 Sep 18 01:05:59.165939 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 491/978] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 18 01:05:59 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 18 01:05:59.177429 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:05:59.177958 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:05:59.184106 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.184594 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.185032 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.185725 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:05:59.186925 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:05:59.187398 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:05:59.264710 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] HTTP exception thrown: Instance 9f5e6940-fbfc-45f5-9e14-08347d250167 is not attached to volume f5821a72-73b3-493a-97ed-82e1f8c05f2c Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Request method failure captured: Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: DELETE /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/os-volume_attachments/f5821a72-73b3-493a-97ed-82e1f8c05f2c HTTP/1.1 Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJm6EVzWhBTSo-LZXK-ZLMluHzG05bHyY0Zmb0v7jYTWEDle9XLD7T1vMSp2dT0HMkPjhtmnoep4DFjR71qU1CmBT117V-s7FEMH0n03AO3VnXBm0fY0pu5cPl18-1SesDx7pJ14_8XpP3R94wqupzmnApHrjjfCEXuY6pKD3FeuoRks Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: 21924b7f5d004b388f3a663a1a2f47b2 Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-TestMinimumBasicScenario-225491163 Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:05:59.267088 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:05:59.268696 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/21924b7f5d004b388f3a663a1a2f47b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/21924b7f5d004b388f3a663a1a2f47b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_21924b7f5d004b388f3a663a1a2f47b2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/21924b7f5d004b388f3a663a1a2f47b2"}]}] Sep 18 01:05:59.268696 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-TestMinimumBasicScenario-225491163 Sep 18 01:05:59.268696 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: 21924b7f5d004b388f3a663a1a2f47b2 Sep 18 01:05:59.268696 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-TestMinimumBasicScenario-225491163 Sep 18 01:05:59.268696 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-TestMinimumBasicScenario-225491163-project Sep 18 01:05:59.268696 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:05:59.268696 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:05:59.268696 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 9e483ed0926b4f76bc5a30e03436654d Sep 18 01:05:59.268696 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-TestMinimumBasicScenario-225491163-project Sep 18 01:05:59.268696 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:05:59.268696 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance 9f5e6940-fbfc-45f5-9e14-08347d250167 is not attached to volume f5821a72-73b3-493a-97ed-82e1f8c05f2c Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'server_id': '9f5e6940-fbfc-45f5-9e14-08347d250167', 'id': 'f5821a72-73b3-493a-97ed-82e1f8c05f2c'} Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f5821a72-73b3-493a-97ed-82e1f8c05f2c. Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:05:59.269509 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5e6940-fbfc-45f5-9e14-08347d250167 is not attached to volume f5821a72-73b3-493a-97ed-82e1f8c05f2c Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5e6940-fbfc-45f5-9e14-08347d250167 is not attached to volume f5821a72-73b3-493a-97ed-82e1f8c05f2c Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:05:59.270959 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Returning 404 to user: Instance 9f5e6940-fbfc-45f5-9e14-08347d250167 is not attached to volume f5821a72-73b3-493a-97ed-82e1f8c05f2c {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:05:59.272020 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d011c970-cb9f-4428-bbb1-aa55563aa19c tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/os-volume_attachments/f5821a72-73b3-493a-97ed-82e1f8c05f2c" status: 404 len: 154 microversion: 2.1 time: 0.095704 Sep 18 01:05:59.272020 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 488/979] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 18 01:05:59 2022] DELETE /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167/os-volume_attachments/f5821a72-73b3-493a-97ed-82e1f8c05f2c => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:06:00.411283 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-25e2e47f-3bde-413f-af62-0f18173ec708 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:00.411803 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-25e2e47f-3bde-413f-af62-0f18173ec708 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:00.418099 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25e2e47f-3bde-413f-af62-0f18173ec708 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:00.418581 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25e2e47f-3bde-413f-af62-0f18173ec708 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:00.419054 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25e2e47f-3bde-413f-af62-0f18173ec708 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:00.419747 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25e2e47f-3bde-413f-af62-0f18173ec708 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:00.420201 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25e2e47f-3bde-413f-af62-0f18173ec708 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:00.421275 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-25e2e47f-3bde-413f-af62-0f18173ec708 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:00.445579 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-25e2e47f-3bde-413f-af62-0f18173ec708 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Going to try to terminate instance {{(pid=120686) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 18 01:06:00.520921 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-25e2e47f-3bde-413f-af62-0f18173ec708 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 204 len: 0 microversion: 2.1 time: 0.112413 Sep 18 01:06:00.524259 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 492/980] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 18 01:06:00 2022] DELETE /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 18 01:06:00.532194 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d2323366-4a8e-46ca-adb5-4e45d289ec86 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:00.533501 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d2323366-4a8e-46ca-adb5-4e45d289ec86 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:00.539499 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d2323366-4a8e-46ca-adb5-4e45d289ec86 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:00.539990 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d2323366-4a8e-46ca-adb5-4e45d289ec86 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:00.540434 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d2323366-4a8e-46ca-adb5-4e45d289ec86 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:00.541165 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d2323366-4a8e-46ca-adb5-4e45d289ec86 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:00.541820 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d2323366-4a8e-46ca-adb5-4e45d289ec86 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:00.542291 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d2323366-4a8e-46ca-adb5-4e45d289ec86 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:00.669134 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-d2323366-4a8e-46ca-adb5-4e45d289ec86 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:00.677375 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d2323366-4a8e-46ca-adb5-4e45d289ec86 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1553 microversion: 2.1 time: 0.149859 Sep 18 01:06:00.677940 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 489/981] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:00 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:01.699918 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-9aceb7a0-8b84-4ea9-8030-9461c8012ed8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:01.700625 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.compute.api [None req-9aceb7a0-8b84-4ea9-8030-9461c8012ed8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120686) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:01.707117 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9aceb7a0-8b84-4ea9-8030-9461c8012ed8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:01.707603 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9aceb7a0-8b84-4ea9-8030-9461c8012ed8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:01.708039 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9aceb7a0-8b84-4ea9-8030-9461c8012ed8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:01.708729 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9aceb7a0-8b84-4ea9-8030-9461c8012ed8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:01.709187 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9aceb7a0-8b84-4ea9-8030-9461c8012ed8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:01.709610 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [None req-9aceb7a0-8b84-4ea9-8030-9461c8012ed8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:01.972540 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.policy [None req-9aceb7a0-8b84-4ea9-8030-9461c8012ed8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120686) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:01.980371 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-9aceb7a0-8b84-4ea9-8030-9461c8012ed8 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1553 microversion: 2.1 time: 0.284732 Sep 18 01:06:01.980934 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 493/982] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:01 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:03.004807 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-17ea0717-5f22-4a64-ae01-3b28c993ca8b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:03.005429 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-17ea0717-5f22-4a64-ae01-3b28c993ca8b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:03.011881 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17ea0717-5f22-4a64-ae01-3b28c993ca8b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:03.012371 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17ea0717-5f22-4a64-ae01-3b28c993ca8b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:03.012806 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17ea0717-5f22-4a64-ae01-3b28c993ca8b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:03.013512 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17ea0717-5f22-4a64-ae01-3b28c993ca8b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:03.013968 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17ea0717-5f22-4a64-ae01-3b28c993ca8b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:03.014394 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-17ea0717-5f22-4a64-ae01-3b28c993ca8b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:03.204051 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.policy [None req-17ea0717-5f22-4a64-ae01-3b28c993ca8b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e483ed0926b4f76bc5a30e03436654d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21924b7f5d004b388f3a663a1a2f47b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120687) authorize /opt/stack/nova/nova/policy.py:199}} Sep 18 01:06:03.216449 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-17ea0717-5f22-4a64-ae01-3b28c993ca8b tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 200 len: 1553 microversion: 2.1 time: 0.215964 Sep 18 01:06:03.217172 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 490/983] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:02 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 18 01:06:03.246027 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [req-fe931b4e-eed9-4291-93a4-e5705f9a264a req-7ebae58b-2df7-4424-bd6c-b4a2541d196a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5e6940-fbfc-45f5-9e14-08347d250167", "name": "network-vif-deleted", "tag": "49102bd9-16f0-43a0-90f2-24b18239858c"}]} {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 18 01:06:03.257527 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-fe931b4e-eed9-4291-93a4-e5705f9a264a req-7ebae58b-2df7-4424-bd6c-b4a2541d196a service nova] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:03.258054 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-fe931b4e-eed9-4291-93a4-e5705f9a264a req-7ebae58b-2df7-4424-bd6c-b4a2541d196a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:03.258496 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG oslo_concurrency.lockutils [req-fe931b4e-eed9-4291-93a4-e5705f9a264a req-7ebae58b-2df7-4424-bd6c-b4a2541d196a service nova] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:03.270010 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.compute.server_external_events [req-fe931b4e-eed9-4291-93a4-e5705f9a264a req-7ebae58b-2df7-4424-bd6c-b4a2541d196a service nova] Creating event network-vif-deleted:49102bd9-16f0-43a0-90f2-24b18239858c for instance 9f5e6940-fbfc-45f5-9e14-08347d250167 on hv-cinder-maste Sep 18 01:06:03.274904 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [req-fe931b4e-eed9-4291-93a4-e5705f9a264a req-7ebae58b-2df7-4424-bd6c-b4a2541d196a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032786 Sep 18 01:06:03.275613 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 494/984] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 18 01:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 18 01:06:04.240403 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '>' {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:04.240998 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.compute.api [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] [instance: 9f5e6940-fbfc-45f5-9e14-08347d250167] Fetching instance by UUID {{(pid=120687) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 18 01:06:04.247399 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:04.247880 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:04.248311 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:04.248996 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Acquiring lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 18 01:06:04.249451 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 18 01:06:04.249896 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG oslo_concurrency.lockutils [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Lock "eb16c1c6-0d79-4315-9c36-c2a3e656bbb3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 18 01:06:04.264073 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.wsgi [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] HTTP exception thrown: Instance 9f5e6940-fbfc-45f5-9e14-08347d250167 could not be found. Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Request method failure captured: Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: request: GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 HTTP/1.1 Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept: application/json Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: Accept-Encoding: identity Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: Connection: close Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Length: 0 Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: Content-Type: application/json Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: Host: 10.222.0.33 Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: Openstack-System-Scope: None Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: User-Agent: python-urllib3/1.26.12 Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Auth-Token: gAAAAABjJm6EVzWhBTSo-LZXK-ZLMluHzG05bHyY0Zmb0v7jYTWEDle9XLD7T1vMSp2dT0HMkPjhtmnoep4DFjR71qU1CmBT117V-s7FEMH0n03AO3VnXBm0fY0pu5cPl18-1SesDx7pJ14_8XpP3R94wqupzmnApHrjjfCEXuY6pKD3FeuoRks Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Id: None Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Domain-Name: None Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Identity-Status: Confirmed Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Is-Admin-Project: True Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Id: default Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Domain-Name: Default Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Id: 21924b7f5d004b388f3a663a1a2f47b2 Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Project-Name: tempest-TestMinimumBasicScenario-225491163 Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Role: reader,member Sep 18 01:06:04.265659 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Roles: reader,member Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/21924b7f5d004b388f3a663a1a2f47b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/21924b7f5d004b388f3a663a1a2f47b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_21924b7f5d004b388f3a663a1a2f47b2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/21924b7f5d004b388f3a663a1a2f47b2"}]}] Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant: tempest-TestMinimumBasicScenario-225491163 Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Id: 21924b7f5d004b388f3a663a1a2f47b2 Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-Tenant-Name: tempest-TestMinimumBasicScenario-225491163 Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User: tempest-TestMinimumBasicScenario-225491163-project Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Id: default Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Domain-Name: Default Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Id: 9e483ed0926b4f76bc5a30e03436654d Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: X-User-Name: tempest-TestMinimumBasicScenario-225491163-project Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: method: > Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: exception: Instance 9f5e6940-fbfc-45f5-9e14-08347d250167 could not be found. Sep 18 01:06:04.268024 dv-cinder-master-3-smb devstack@n-api.service[120687]: action_args: {'id': '9f5e6940-fbfc-45f5-9e14-08347d250167'} Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: {{(pid=120687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5e6940-fbfc-45f5-9e14-08347d250167 could not be found. Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 18 01:06:04.269112 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5e6940-fbfc-45f5-9e14-08347d250167 could not be found. Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5e6940-fbfc-45f5-9e14-08347d250167 could not be found. Sep 18 01:06:04.270869 dv-cinder-master-3-smb devstack@n-api.service[120687]: ERROR nova.api.openstack.wsgi Sep 18 01:06:04.272489 dv-cinder-master-3-smb devstack@n-api.service[120687]: DEBUG nova.api.openstack.wsgi [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Returning 404 to user: Instance 9f5e6940-fbfc-45f5-9e14-08347d250167 could not be found. {{(pid=120687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 18 01:06:04.272489 dv-cinder-master-3-smb devstack@n-api.service[120687]: INFO nova.api.openstack.requestlog [None req-d876fb19-17e7-49fd-96f7-5bd46c3c38b1 tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167" status: 404 len: 111 microversion: 2.1 time: 0.031763 Sep 18 01:06:04.272489 dv-cinder-master-3-smb devstack@n-api.service[120687]: [pid: 120687|app: 0|req: 491/985] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 18 01:06:04 2022] GET /compute/v2.1/servers/9f5e6940-fbfc-45f5-9e14-08347d250167 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 18 01:06:04.277804 dv-cinder-master-3-smb devstack@n-api.service[120686]: DEBUG nova.api.openstack.wsgi [None req-48544525-2ac4-4ca6-9b6c-3a1af52efc5d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] Calling method '.version_select at 0x7f5672bd5a60>' {{(pid=120686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 18 01:06:04.296561 dv-cinder-master-3-smb devstack@n-api.service[120686]: INFO nova.api.openstack.requestlog [None req-48544525-2ac4-4ca6-9b6c-3a1af52efc5d tempest-TestMinimumBasicScenario-225491163 tempest-TestMinimumBasicScenario-225491163-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-610239297" status: 202 len: 0 microversion: 2.1 time: 0.023404 Sep 18 01:06:04.297121 dv-cinder-master-3-smb devstack@n-api.service[120686]: [pid: 120686|app: 0|req: 495/986] 10.222.0.33 () {58 vars in 1269 bytes} [Sun Sep 18 01:06:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-610239297 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)